Aug 03 23:29:57.936308 ip-10-0-138-58 systemd[1]: Starting Kubernetes Kubelet...
Aug 03 23:29:58.335802 ip-10-0-138-58 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 03 23:29:58.335802 ip-10-0-138-58 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 03 23:29:58.335802 ip-10-0-138-58 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 03 23:29:58.335802 ip-10-0-138-58 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 03 23:29:58.335802 ip-10-0-138-58 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 03 23:29:58.337965 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.337862    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 03 23:29:58.343564 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343546    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 03 23:29:58.343564 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343564    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343570    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343574    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343577    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343580    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343583    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343586    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343589    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343591    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343595    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343598    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343601    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343604    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343606    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343609    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343611    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343618    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343621    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343624    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 03 23:29:58.343635 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343627    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343630    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343635    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343639    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343642    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343645    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343647    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343651    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343655    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343659    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343662    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343665    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343668    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343672    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343675    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343677    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343680    2568 feature_gate.go:328] unrecognized feature gate: Example2
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343683    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343685    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 03 23:29:58.344112 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343688    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343690    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343693    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343695    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343698    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343700    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343702    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343705    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343707    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343710    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343712    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343714    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343717    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343720    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343722    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343726    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343729    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343731    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343734    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343736    2568 feature_gate.go:328] unrecognized feature gate: Example
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343739    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 03 23:29:58.344578 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343742    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343744    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343747    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343749    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343752    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343754    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343757    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343759    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343762    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343765    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343767    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343771    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343774    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343776    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343779    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343781    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343784    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343786    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343789    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 03 23:29:58.345113 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343792    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343794    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343797    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343800    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343802    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343806    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343808    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343811    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343814    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343816    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343819    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343822    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343825    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343827    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343830    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343832    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343835    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343837    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343840    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.343842    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 03 23:29:58.345562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344677    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344691    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344694    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344699    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344704    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344708    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344712    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344714    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344717    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344720    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344722    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344725    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344727    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344730    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344732    2568 feature_gate.go:328] unrecognized feature gate: Example
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344735    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344738    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344740    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344743    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 03 23:29:58.346084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344745    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344748    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344751    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344753    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344756    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344760    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344762    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344765    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344768    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344770    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344773    2568 feature_gate.go:328] unrecognized feature gate: Example2
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344776    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344779    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344782    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344785    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344787    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344790    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344793    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344795    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344798    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 03 23:29:58.346606 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344800    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344803    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344805    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344808    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344810    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344813    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344815    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344817    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344820    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344822    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344825    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344827    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344829    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344832    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344835    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344838    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344840    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344842    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344846    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 03 23:29:58.347120 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344848    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344850    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344853    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344855    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344858    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344860    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344864    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344867    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344869    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344872    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344874    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344877    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344879    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344881    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344884    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344886    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344889    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344891    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344893    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 03 23:29:58.347597 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344896    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344900    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344903    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344906    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344910    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344914    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344917    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344919    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344926    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344929    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344944    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344947    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344950    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344953    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344955    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344958    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344961    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344963    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344966    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344969    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 03 23:29:58.348080 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344971    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.344974    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345387    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345393    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345396    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345399    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345402    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345404    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345406    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345409    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345411    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345414    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345417    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345420    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345422    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345424    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345427    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345429    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345432    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345434    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 03 23:29:58.348573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345438    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345441    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345444    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345447    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345449    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345452    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345454    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345457    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345459    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345461    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345465    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345467    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345470    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345472    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345475    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345477    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345480    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345482    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345484    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345487    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 03 23:29:58.349082 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345489    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345491    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345494    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345496    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345498    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345501    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345503    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345505    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345509    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345512    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345515    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345517    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345521    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345524    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345526    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345529    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345531    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345533    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345536    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 03 23:29:58.349572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345539    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345541    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345543    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345546    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345548    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345551    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345554    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345557    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345559    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345562    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345564    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345567    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345570    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345572    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345575    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345579    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345581    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345584    2568 feature_gate.go:328] unrecognized feature gate: Example
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345586    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345589    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 03 23:29:58.350048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345591    2568 feature_gate.go:328] unrecognized feature gate: Example2
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345594    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345596    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345599    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345601    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345604    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345607    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345609    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345611    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345614    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345616    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345618    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345621    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345624    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345627    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345631    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345633    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345637    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345639    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 03 23:29:58.350626 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345643    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345646    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.345649    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345715    2568 flags.go:64] FLAG: --address="0.0.0.0"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345722    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345728    2568 flags.go:64] FLAG: --anonymous-auth="true"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345733    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345737    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345740    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345755    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345759    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345762    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345765    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345768    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345772    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345775    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345778    2568 flags.go:64] FLAG: --cgroup-root=""
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345780    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345783    2568 flags.go:64] FLAG: --client-ca-file=""
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345786    2568 flags.go:64] FLAG: --cloud-provider="external"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345789    2568 flags.go:64] FLAG: --cluster-dns="[]"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345792    2568 flags.go:64] FLAG: --cluster-domain=""
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345795    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 03 23:29:58.351143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345799    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345802    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345805    2568 flags.go:64] FLAG: --container-log-max-files="5"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345809    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345812    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345815    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345819    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345823    2568 flags.go:64] FLAG: --contention-profiling="false"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345826    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345829    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345832    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345835    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345839    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345842    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345845    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345848    2568 flags.go:64] FLAG: --enable-load-reader="false"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345852    2568 flags.go:64] FLAG: --enable-server="true"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345855    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345859    2568 flags.go:64] FLAG: --event-burst="100"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345862    2568 flags.go:64] FLAG: --event-qps="50"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345865    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345868    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345871    2568 flags.go:64] FLAG: --eviction-hard=""
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345875    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 03 23:29:58.351688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345877    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345880    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345883    2568 flags.go:64] FLAG: --eviction-soft=""
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345886    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345889    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345892    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345895    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345897    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345901    2568 flags.go:64] FLAG: --fail-swap-on="true"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345903    2568 flags.go:64] FLAG: --feature-gates=""
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345907    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345910    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345913    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345916    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345919    2568 flags.go:64] FLAG: --healthz-port="10248"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345923    2568 flags.go:64] FLAG: --help="false"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345926    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345929    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345946    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345949    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345953    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345956    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345959    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 03 23:29:58.352267 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345962    2568 flags.go:64] FLAG: --image-service-endpoint=""
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345964    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345967    2568 flags.go:64] FLAG: --kube-api-burst="100"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345970    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345973    2568 flags.go:64] FLAG: --kube-api-qps="50"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345976    2568 flags.go:64] FLAG: --kube-reserved=""
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345979    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345982    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345985    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345988    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345990    2568 flags.go:64] FLAG: --lock-file=""
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345993    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345996    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.345999    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346004    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346007    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346010    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346013    2568 flags.go:64] FLAG: --logging-format="text"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346016    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346019    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346022    2568 flags.go:64] FLAG: --manifest-url=""
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346025    2568 flags.go:64] FLAG: --manifest-url-header=""
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346029    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346032    2568 flags.go:64] FLAG: --max-open-files="1000000"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346039    2568 flags.go:64] FLAG: --max-pods="110"
Aug 03 23:29:58.352869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346042    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346045    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346047    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346050    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346053    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346056    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346058    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346065    2568 flags.go:64] FLAG: --node-status-max-images="50"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346068    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346071    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346074    2568 flags.go:64] FLAG: --pod-cidr=""
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346077    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346083    2568 flags.go:64] FLAG: --pod-manifest-path=""
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346085    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346088    2568 flags.go:64] FLAG: --pods-per-core="0"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346091    2568 flags.go:64] FLAG: --port="10250"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346095    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346098    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-056324ff8e2396594"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346101    2568 flags.go:64] FLAG: --qos-reserved=""
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346103    2568 flags.go:64] FLAG: --read-only-port="10255"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346108    2568 flags.go:64] FLAG: --register-node="true"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346110    2568 flags.go:64] FLAG: --register-with-taints=""
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346114    2568 flags.go:64] FLAG: --registry-burst="10"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346116    2568 flags.go:64] FLAG: --registry-qps="5"
Aug 03 23:29:58.353695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346119    2568 flags.go:64] FLAG: --reserved-cpus=""
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346122    2568 flags.go:64] FLAG: --reserved-memory=""
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346125    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346128    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346131    2568 flags.go:64] FLAG: --rotate-certificates="false"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346134    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346137    2568 flags.go:64] FLAG: --runonce="false"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346141    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346144    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346147    2568 flags.go:64] FLAG: --seccomp-default="false"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346149    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346152    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346155    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346158    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346161    2568 flags.go:64] FLAG: --storage-driver-password="root"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346163    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346166    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346169    2568 flags.go:64] FLAG: --storage-driver-user="root"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346171    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346174    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346177    2568 flags.go:64] FLAG: --system-cgroups=""
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346180    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346185    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346188    2568 flags.go:64] FLAG: --tls-cert-file=""
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346190    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 03 23:29:58.354557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346194    2568 flags.go:64] FLAG: --tls-min-version=""
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346197    2568 flags.go:64] FLAG: --tls-private-key-file=""
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346200    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346203    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346206    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346209    2568 flags.go:64] FLAG: --v="2"
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346213    2568 flags.go:64] FLAG: --version="false"
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346217    2568 flags.go:64] FLAG: --vmodule=""
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346220    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.346223    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346342    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346346    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346349    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346352    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346357    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346359    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346362    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346365    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346367    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346370    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346372    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346375    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 03 23:29:58.355247 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346377    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346380    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346382    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346384    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346388    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346392    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346394    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346397    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346399    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346402    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346404    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346407    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346409    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346412    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346415    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346427    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346431    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346434    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346436    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346439    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 03 23:29:58.355782 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346442    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346444    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346447    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346450    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346454    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346457    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346459    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346462    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346464    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346467    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346469    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346472    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346474    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346477    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346479    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346482    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346484    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346487    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346489    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346491    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 03 23:29:58.356289 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346493    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346496    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346498    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346501    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346503    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346507    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346509    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346512    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346514    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346517    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346519    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346521    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346524    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346526    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346529    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346531    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346535    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346537    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346541    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 03 23:29:58.356766 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346545    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346549    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346552    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346555    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346557    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346560    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346563    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346566    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346569    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346571    2568 feature_gate.go:328] unrecognized feature gate: Example
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346574    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346577    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346580    2568 feature_gate.go:328] unrecognized feature gate: Example2
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346582    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346584    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346587    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346589    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346592    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346596    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 03 23:29:58.357258 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346598    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346600    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346603    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346606    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346609    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346611    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346614    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346616    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.346619    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.347198    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.355564    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.355587    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.356404    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.356411    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356474    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 03 23:29:58.357718 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356480    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356484    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356488    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356491    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356494    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356497    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356500    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356503    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356506    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356508    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356511    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356513    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356516    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356520    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356529    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356532    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356535    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356538    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356540    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 03 23:29:58.358188 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356543    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356545    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356548    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356551    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356553    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356556    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356558    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356561    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356564    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356567    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356571    2568 feature_gate.go:328] unrecognized feature gate: Example2
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356573    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356576    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356580    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356584    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356587    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356589    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356593    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356595    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 03 23:29:58.358650 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356598    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356601    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356604    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356606    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356609    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356611    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356614    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356618    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356620    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356623    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356625    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356628    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356630    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356632    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356635    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356637    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356640    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356642    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356645    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 03 23:29:58.359119 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356647    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356650    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356653    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356656    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356660    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356663    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356666    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356669    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356672    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356675    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356677    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356680    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356682    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356685    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356687    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356690    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356692    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356695    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356697    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356700    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 03 23:29:58.359562 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356702    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356706    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356709    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356711    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356714    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356716    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356718    2568 feature_gate.go:328] unrecognized feature gate: Example
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356722    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356724    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356727    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356729    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356731    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356734    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356737    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356740    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356743    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356745    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356748    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356751    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356753    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 03 23:29:58.360048 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356756    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.356761    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356884    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356889    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356892    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356894    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356897    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356899    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356902    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356905    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356907    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356909    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356912    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356914    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356917    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 03 23:29:58.360531 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356921    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356925    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356927    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356930    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356949    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356952    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356955    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356957    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356960    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356963    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356965    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356968    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356971    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356973    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356976    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356978    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356981    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356983    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356986    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356988    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 03 23:29:58.360984 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356991    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356993    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356996    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.356999    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357001    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357004    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357006    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357010    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357013    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357021    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357025    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357028    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357032    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357034    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357037    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357040    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357042    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357045    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357048    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 03 23:29:58.361469 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357050    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357053    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357056    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357058    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357060    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357063    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357066    2568 feature_gate.go:328] unrecognized feature gate: Example2
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357069    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357071    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357074    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357076    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357078    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357081    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357084    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357086    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357089    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357091    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357094    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357096    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357099    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 03 23:29:58.362026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357101    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357103    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357106    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357108    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357110    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357113    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357116    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357119    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357122    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357124    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357127    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357129    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357131    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357134    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357136    2568 feature_gate.go:328] unrecognized feature gate: Example
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357139    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357141    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357145    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357147    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357150    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 03 23:29:58.362519 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357153    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357155    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357158    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357160    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357163    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357165    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:29:58.357167    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.357173    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.357335    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.359406    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.361057    2568 server.go:1019] "Starting client certificate rotation"
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.361157    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 03 23:29:58.363010 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.361731    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 03 23:29:58.363848 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.363833    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 03 23:29:58.370601 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.370584    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 03 23:29:58.382197 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.382178    2568 log.go:25] "Validated CRI v1 runtime API"
Aug 03 23:29:58.384264 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.384247    2568 log.go:25] "Validated CRI v1 image API"
Aug 03 23:29:58.385037 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.385014    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 03 23:29:58.390615 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.390588    2568 fs.go:135] Filesystem UUIDs: map[4320a249-5fa9-4a87-96d4-d7ca21d4489b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7fb0235d-3a1b-4831-9a17-9013c5e8b313:/dev/nvme0n1p4]
Aug 03 23:29:58.390710 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.390614    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 03 23:29:58.391904 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.391881    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 03 23:29:58.397742 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.397623    2568 manager.go:216] Machine: {Timestamp:2026-08-03 23:29:58.396050207 +0000 UTC m=+0.343703640 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092847 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2237d0d6720e8255c88161bb3bdcc8 SystemUUID:ec2237d0-d672-0e82-55c8-8161bb3bdcc8 BootID:09988c7b-2565-4d8e-a54c-b5b61bde3203 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:70:98:10:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:70:98:10:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:de:d0:42:bd:9a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 03 23:29:58.397742 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.397731    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 03 23:29:58.397887 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.397816    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 03 23:29:58.399667 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.399634    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 03 23:29:58.399831 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.399672    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-58.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 03 23:29:58.400459 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.400448    2568 topology_manager.go:138] "Creating topology manager with none policy"
Aug 03 23:29:58.400512 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.400466    2568 container_manager_linux.go:309] "Creating device plugin manager"
Aug 03 23:29:58.400512 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.400476    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 03 23:29:58.401135 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.401123    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 03 23:29:58.402337 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.402325    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 03 23:29:58.406121 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.406108    2568 state_mem.go:36] "Initialized new in-memory state store"
Aug 03 23:29:58.406265 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.406253    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 03 23:29:58.406325 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.406292    2568 kubelet.go:486] "Attempting to sync node with API server"
Aug 03 23:29:58.406325 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.406307    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 03 23:29:58.406325 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.406323    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 03 23:29:58.406452 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.406338    2568 kubelet.go:398] "Adding apiserver pod source"
Aug 03 23:29:58.406452 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.406352    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 03 23:29:58.406815 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.406800    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 03 23:29:58.406952 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.406825    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 03 23:29:58.409097 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.409080    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 03 23:29:58.410291 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.410274    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bjxk2"
Aug 03 23:29:58.410498 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.410483    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 03 23:29:58.410558 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.410523    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 03 23:29:58.411243 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411230    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 03 23:29:58.411302 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411251    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 03 23:29:58.411302 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411260    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 03 23:29:58.411302 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411268    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 03 23:29:58.411302 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411279    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 03 23:29:58.411302 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411287    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 03 23:29:58.411478 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411468    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 03 23:29:58.411523 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411480    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 03 23:29:58.411523 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411491    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 03 23:29:58.411523 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411500    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 03 23:29:58.411523 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411513    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 03 23:29:58.411651 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.411526    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 03 23:29:58.412486 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.412475    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 03 23:29:58.412532 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.412489    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 03 23:29:58.415648 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.415633    2568 server.go:1268] "Started kubelet"
Aug 03 23:29:58.415998 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.415969    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 03 23:29:58.416167 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.416146    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 03 23:29:58.416260 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.415769    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 03 23:29:58.416636 ip-10-0-138-58 systemd[1]: Started Kubernetes Kubelet.
Aug 03 23:29:58.417381 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.417216    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 03 23:29:58.418426 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.418393    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bjxk2"
Aug 03 23:29:58.418575 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.418561    2568 server.go:310] "Adding debug handlers to kubelet server"
Aug 03 23:29:58.419206 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.419172    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-58.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 03 23:29:58.419294 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.419210    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 03 23:29:58.419294 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.419273    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 03 23:29:58.423027 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.423002    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 03 23:29:58.425997 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.425979    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 03 23:29:58.426092 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.426002    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 03 23:29:58.426149 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.426110    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:29:58.426686 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.426670    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 03 23:29:58.426686 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.426671    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 03 23:29:58.426808 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.426697    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 03 23:29:58.426860 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.426817    2568 reconstruct.go:97] "Volume reconstruction finished"
Aug 03 23:29:58.426860 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.426826    2568 reconciler.go:29] "Reconciler: start to sync state"
Aug 03 23:29:58.427181 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.427165    2568 factory.go:55] Registering systemd factory
Aug 03 23:29:58.427181 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.427182    2568 factory.go:223] Registration of the systemd container factory successfully
Aug 03 23:29:58.427387 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.427376    2568 factory.go:153] Registering CRI-O factory
Aug 03 23:29:58.427387 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.427388    2568 factory.go:223] Registration of the crio container factory successfully
Aug 03 23:29:58.427472 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.427444    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 03 23:29:58.427472 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.427462    2568 factory.go:103] Registering Raw factory
Aug 03 23:29:58.427472 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.427473    2568 manager.go:1196] Started watching for new ooms in manager
Aug 03 23:29:58.428172 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.428155    2568 manager.go:349] Starting recovery of all containers
Aug 03 23:29:58.428629 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.428558    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 03 23:29:58.431805 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.431776    2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-58.ec2.internal\" not found" node="ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.441905 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.441741    2568 manager.go:354] Recovery completed
Aug 03 23:29:58.446184 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.446167    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 03 23:29:58.448131 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.448112    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientMemory"
Aug 03 23:29:58.448216 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.448144    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasNoDiskPressure"
Aug 03 23:29:58.448216 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.448155    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientPID"
Aug 03 23:29:58.448681 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.448665    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 03 23:29:58.448681 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.448680    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 03 23:29:58.448799 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.448692    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 03 23:29:58.448799 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.448696    2568 state_mem.go:36] "Initialized new in-memory state store"
Aug 03 23:29:58.449547 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.449529    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientMemory"
Aug 03 23:29:58.449606 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.449563    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasNoDiskPressure"
Aug 03 23:29:58.449606 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.449578    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientPID"
Aug 03 23:29:58.450022 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.450007    2568 policy_none.go:49] "None policy: Start"
Aug 03 23:29:58.450022 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.450024    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 03 23:29:58.450131 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.450037    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 03 23:29:58.451081 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.451070    2568 policy_none.go:47] "Start"
Aug 03 23:29:58.485526 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.485506    2568 manager.go:337] "Starting Device Plugin manager"
Aug 03 23:29:58.485615 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.485543    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 03 23:29:58.485615 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.485557    2568 server.go:87] "Starting device plugin registration server"
Aug 03 23:29:58.485838 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.485825    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 03 23:29:58.485907 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.485840    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 03 23:29:58.486044 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.486025    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 03 23:29:58.486118 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.486107    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 03 23:29:58.486163 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.486119    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 03 23:29:58.486584 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.486567    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 03 23:29:58.486663 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.486618    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:29:58.586487 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.586383    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 03 23:29:58.588008 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.587567    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientMemory"
Aug 03 23:29:58.588008 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.587601    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasNoDiskPressure"
Aug 03 23:29:58.588008 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.587611    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientPID"
Aug 03 23:29:58.588008 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.587640    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.590689 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.590656    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 03 23:29:58.592054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.592033    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 03 23:29:58.592150 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.592070    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 03 23:29:58.592150 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.592097    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 03 23:29:58.592150 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.592137    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 03 23:29:58.594127 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.594108    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.594249 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.594130    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-58.ec2.internal\": node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:29:58.594537 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.594515    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 03 23:29:58.616399 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.616369    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:29:58.692750 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.692718    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal"]
Aug 03 23:29:58.692895 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.692811    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 03 23:29:58.694492 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.694476    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientMemory"
Aug 03 23:29:58.694560 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.694510    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasNoDiskPressure"
Aug 03 23:29:58.694560 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.694523    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientPID"
Aug 03 23:29:58.696067 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.696054    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 03 23:29:58.696205 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.696190    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.696247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.696236    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 03 23:29:58.696865 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.696851    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientMemory"
Aug 03 23:29:58.696948 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.696876    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasNoDiskPressure"
Aug 03 23:29:58.696948 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.696886    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientPID"
Aug 03 23:29:58.697276 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.697264    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientMemory"
Aug 03 23:29:58.697327 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.697288    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasNoDiskPressure"
Aug 03 23:29:58.697327 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.697298    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientPID"
Aug 03 23:29:58.698376 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.698359    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.698482 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.698388    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 03 23:29:58.699108 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.699089    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientMemory"
Aug 03 23:29:58.699191 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.699124    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasNoDiskPressure"
Aug 03 23:29:58.699191 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.699139    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeHasSufficientPID"
Aug 03 23:29:58.716487 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.716459    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-58.ec2.internal\" not found" node="ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.716655 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.716639    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:29:58.720299 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.720282    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-58.ec2.internal\" not found" node="ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.728187 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.728170    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1339c26736d1236ea39fb7a5abb5e0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal\" (UID: \"d1339c26736d1236ea39fb7a5abb5e0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.728250 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.728195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1339c26736d1236ea39fb7a5abb5e0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal\" (UID: \"d1339c26736d1236ea39fb7a5abb5e0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.728250 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.728213    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5fc83fdf27a40daf0d9c3c0b65f08da-config\") pod \"kube-apiserver-proxy-ip-10-0-138-58.ec2.internal\" (UID: \"b5fc83fdf27a40daf0d9c3c0b65f08da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.817248 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.817216    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:29:58.828593 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.828568    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1339c26736d1236ea39fb7a5abb5e0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal\" (UID: \"d1339c26736d1236ea39fb7a5abb5e0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.828650 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.828597    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1339c26736d1236ea39fb7a5abb5e0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal\" (UID: \"d1339c26736d1236ea39fb7a5abb5e0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.828650 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.828623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5fc83fdf27a40daf0d9c3c0b65f08da-config\") pod \"kube-apiserver-proxy-ip-10-0-138-58.ec2.internal\" (UID: \"b5fc83fdf27a40daf0d9c3c0b65f08da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.828748 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.828660    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1339c26736d1236ea39fb7a5abb5e0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal\" (UID: \"d1339c26736d1236ea39fb7a5abb5e0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.828748 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.828675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1339c26736d1236ea39fb7a5abb5e0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal\" (UID: \"d1339c26736d1236ea39fb7a5abb5e0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.828748 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:58.828706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5fc83fdf27a40daf0d9c3c0b65f08da-config\") pod \"kube-apiserver-proxy-ip-10-0-138-58.ec2.internal\" (UID: \"b5fc83fdf27a40daf0d9c3c0b65f08da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:58.918083 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:58.918006    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:29:59.018545 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:29:59.018507    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:29:59.018639 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:59.018549    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal"
Aug 03 23:29:59.023732 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:29:59.023262    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal"
Aug 03 23:30:00.180032 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:00.179991    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:30:00.280569 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:00.280491    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:30:00.381073 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:00.381042    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:30:00.421653 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.421624    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 03 23:30:00.422183 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.421790    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 03 23:30:00.422183 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.421825    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 03 23:30:00.481269 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:00.481227    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:30:00.481788 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.481741    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-02 23:24:59 +0000 UTC" deadline="2028-01-11 12:06:34.25038597 +0000 UTC"
Aug 03 23:30:00.481788 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.481781    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12612h36m33.768608833s"
Aug 03 23:30:00.582081 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:00.582012    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:30:00.606052 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:30:00.606014    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5fc83fdf27a40daf0d9c3c0b65f08da.slice/crio-d66f7cfb1c26a7bacf1d59afcbdb335c357aea67df4cb14a0e862990ce34b0b9 WatchSource:0}: Error finding container d66f7cfb1c26a7bacf1d59afcbdb335c357aea67df4cb14a0e862990ce34b0b9: Status 404 returned error can't find the container with id d66f7cfb1c26a7bacf1d59afcbdb335c357aea67df4cb14a0e862990ce34b0b9
Aug 03 23:30:00.608475 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:30:00.608426    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1339c26736d1236ea39fb7a5abb5e0e.slice/crio-e80d15f3a0bd0af2918b40fcb7df53e16cba8a6f36d2614951755434a0caead3 WatchSource:0}: Error finding container e80d15f3a0bd0af2918b40fcb7df53e16cba8a6f36d2614951755434a0caead3: Status 404 returned error can't find the container with id e80d15f3a0bd0af2918b40fcb7df53e16cba8a6f36d2614951755434a0caead3
Aug 03 23:30:00.612283 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.612251    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 03 23:30:00.657670 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.657616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal" event={"ID":"d1339c26736d1236ea39fb7a5abb5e0e","Type":"ContainerStarted","Data":"e80d15f3a0bd0af2918b40fcb7df53e16cba8a6f36d2614951755434a0caead3"}
Aug 03 23:30:00.658626 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.658604    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal" event={"ID":"b5fc83fdf27a40daf0d9c3c0b65f08da","Type":"ContainerStarted","Data":"d66f7cfb1c26a7bacf1d59afcbdb335c357aea67df4cb14a0e862990ce34b0b9"}
Aug 03 23:30:00.679484 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.679455    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 03 23:30:00.682298 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:00.682278    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:30:00.782820 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:00.782768    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:30:00.883449 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:00.883343    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-58.ec2.internal\" not found"
Aug 03 23:30:00.916173 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.916142    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 03 23:30:00.988502 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.988470    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal"
Aug 03 23:30:00.999971 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:00.999943    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 03 23:30:01.000973 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.000953    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal"
Aug 03 23:30:01.010030 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.010001    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 03 23:30:01.468742 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.468638    2568 apiserver.go:52] "Watching apiserver"
Aug 03 23:30:01.477957 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.477920    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 03 23:30:01.478572 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.478545    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-mwgl4","openshift-network-operator/iptables-alerter-6fpgs","openshift-ovn-kubernetes/ovnkube-node-kdctm","kube-system/global-pull-secret-syncer-8dchf","kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm","openshift-dns/node-resolver-fr6nj","openshift-image-registry/node-ca-w5jl6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal","openshift-multus/multus-additional-cni-plugins-rfhcj","openshift-multus/multus-bnjh9","kube-system/konnectivity-agent-4glt4","openshift-cluster-node-tuning-operator/tuned-hn5rg","openshift-multus/network-metrics-daemon-bd4gd"]
Aug 03 23:30:01.480628 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.480205    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.482075 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.481578    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.482361 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.482339    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 03 23:30:01.482467 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.482417    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 03 23:30:01.482534 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.482470    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hhcnt\""
Aug 03 23:30:01.482885 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.482860    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.483843 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.483824    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 03 23:30:01.484155 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.484139    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 03 23:30:01.484358 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.484340    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 03 23:30:01.484726 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.484712    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 03 23:30:01.484876 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.484861    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jv85z\""
Aug 03 23:30:01.485157 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.485144    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 03 23:30:01.485716 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.485696    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:01.485806 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.485773    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:01.485982 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.485950    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 03 23:30:01.486051 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.485996    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nnkp8\""
Aug 03 23:30:01.486216 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.486199    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:01.486317 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.486219    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 03 23:30:01.486317 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.486287    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:01.486420 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.486404    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 03 23:30:01.486588 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.486570    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 03 23:30:01.486683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.486664    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 03 23:30:01.487066 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.487042    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.487984 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.487964    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 03 23:30:01.489042 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.489022    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 03 23:30:01.489137 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.489059    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.489213 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.489196    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 03 23:30:01.489609 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.489549    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2fgvc\""
Aug 03 23:30:01.489609 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.489576    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 03 23:30:01.490084 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.490064    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.491243 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.491203    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 03 23:30:01.494046 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.494025    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 03 23:30:01.494391 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.494364    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.494964 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.494808    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 03 23:30:01.494964 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.494857    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 03 23:30:01.494964 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.494917    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 03 23:30:01.495202 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.495192    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r62jc\""
Aug 03 23:30:01.495324 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.495198    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hbdz7\""
Aug 03 23:30:01.496709 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.496688    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.497165 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497147    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497341    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-sys-fs\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497370    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-run-k8s-cni-cncf-io\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497395    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-registration-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497417    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-device-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497431    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5jrxl\""
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497441    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztf9m\" (UniqueName: \"kubernetes.io/projected/11b51a67-54b6-403b-896b-d9c44784d6eb-kube-api-access-ztf9m\") pod \"node-resolver-fr6nj\" (UID: \"11b51a67-54b6-403b-896b-d9c44784d6eb\") " pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-etc-openvswitch\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497485    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-run-openvswitch\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497508    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-tmp\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-cnibin\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497551    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-host\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497573    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497596    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/11b51a67-54b6-403b-896b-d9c44784d6eb-hosts-file\") pod \"node-resolver-fr6nj\" (UID: \"11b51a67-54b6-403b-896b-d9c44784d6eb\") " pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497619    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11b51a67-54b6-403b-896b-d9c44784d6eb-tmp-dir\") pod \"node-resolver-fr6nj\" (UID: \"11b51a67-54b6-403b-896b-d9c44784d6eb\") " pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-kubelet\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497659    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-run-systemd\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497598    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 03 23:30:01.497871 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497679    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-run-ovn\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497759    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-cni-netd\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497794    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-log-socket\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497817    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-cni-bin\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497840    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01757aa1-aae7-49d5-a04f-a071a1e659eb-ovnkube-config\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497854    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497872    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32799c08-ecb0-4c70-accb-1a420eab06d4-serviceca\") pod \"node-ca-w5jl6\" (UID: \"32799c08-ecb0-4c70-accb-1a420eab06d4\") " pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497895    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce32525a-a080-4032-808a-be6c753b90d6-cni-binary-copy\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497918    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-run-netns\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.497924    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497944    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-run-netns\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497970    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-systemd\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.497994    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-lib-modules\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-etc-selinux\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498050    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-sysctl-d\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498163    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-tuned\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.498769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjb2h\" (UniqueName: \"kubernetes.io/projected/d639c716-fe87-49b7-88b7-7c07ea4a7199-kube-api-access-rjb2h\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498223    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01757aa1-aae7-49d5-a04f-a071a1e659eb-env-overrides\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-hostroot\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-systemd-units\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498304    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-var-lib-openvswitch\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498323    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01757aa1-aae7-49d5-a04f-a071a1e659eb-ovn-node-metrics-cert\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498343    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-modprobe-d\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498364    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-multus-cni-dir\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498390    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498386    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-multus-socket-dir-parent\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498458    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-var-lib-cni-bin\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-etc-kubernetes\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-var-lib-kubelet\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-var-lib-kubelet\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498557    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce32525a-a080-4032-808a-be6c753b90d6-multus-daemon-config\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndg8v\" (UniqueName: \"kubernetes.io/projected/ce32525a-a080-4032-808a-be6c753b90d6-kube-api-access-ndg8v\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-kubelet-config\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:01.499539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-system-cni-dir\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498648    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28dqf\" (UniqueName: \"kubernetes.io/projected/32799c08-ecb0-4c70-accb-1a420eab06d4-kube-api-access-28dqf\") pod \"node-ca-w5jl6\" (UID: \"32799c08-ecb0-4c70-accb-1a420eab06d4\") " pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-run-multus-certs\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32799c08-ecb0-4c70-accb-1a420eab06d4-host\") pod \"node-ca-w5jl6\" (UID: \"32799c08-ecb0-4c70-accb-1a420eab06d4\") " pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498716    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnl44\" (UniqueName: \"kubernetes.io/projected/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-kube-api-access-bnl44\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-var-lib-cni-multus\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498786    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-socket-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499030    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-kubernetes\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499050    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-sysctl-conf\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499070    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-run\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499165    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498871    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.498982    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499383    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-dbus\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499411    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k6tc\" (UniqueName: \"kubernetes.io/projected/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-kube-api-access-5k6tc\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499432    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499455    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-node-log\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499478    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm2cw\" (UniqueName: \"kubernetes.io/projected/01757aa1-aae7-49d5-a04f-a071a1e659eb-kube-api-access-vm2cw\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.501054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:01.501881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499525    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01757aa1-aae7-49d5-a04f-a071a1e659eb-ovnkube-script-lib\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.501881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499546    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-sys\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.501881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499580    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-os-release\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.501881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499604    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-multus-conf-dir\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.501881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:01.501881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499661    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-slash\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.501881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.499692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-sysconfig\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.501881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.500385    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-52d26\""
Aug 03 23:30:01.501881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.501703    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cwqtl\""
Aug 03 23:30:01.501881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.501757    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 03 23:30:01.502238 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.502087    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 03 23:30:01.502506 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.502462    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 03 23:30:01.528554 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.528523    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k7krv"
Aug 03 23:30:01.534446 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.534423    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k7krv"
Aug 03 23:30:01.589904 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.589878    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 03 23:30:01.599904 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.599869    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k6tc\" (UniqueName: \"kubernetes.io/projected/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-kube-api-access-5k6tc\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:01.600064 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.599909    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.600064 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.599940    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-node-log\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.600064 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.599997    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-node-log\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.600064 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600010    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.600254 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600107    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm2cw\" (UniqueName: \"kubernetes.io/projected/01757aa1-aae7-49d5-a04f-a071a1e659eb-kube-api-access-vm2cw\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.600254 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:01.600254 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600150    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r528t\" (UniqueName: \"kubernetes.io/projected/aa302717-cab9-45f2-8638-40c2192c4ac2-kube-api-access-r528t\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.600254 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01757aa1-aae7-49d5-a04f-a071a1e659eb-ovnkube-script-lib\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.600254 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600183    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-sys\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.600254 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600197    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-os-release\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.600254 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600212    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-multus-conf-dir\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.600254 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ceee6ed-cf02-4553-88c2-ffdfe0023c33-host-slash\") pod \"iptables-alerter-6fpgs\" (UID: \"2ceee6ed-cf02-4553-88c2-ffdfe0023c33\") " pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.600254 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600250    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa302717-cab9-45f2-8638-40c2192c4ac2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600292    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-slash\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600327    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-sysconfig\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-sys-fs\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-run-k8s-cni-cncf-io\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-registration-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-device-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600399    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztf9m\" (UniqueName: \"kubernetes.io/projected/11b51a67-54b6-403b-896b-d9c44784d6eb-kube-api-access-ztf9m\") pod \"node-resolver-fr6nj\" (UID: \"11b51a67-54b6-403b-896b-d9c44784d6eb\") " pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600422    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-etc-openvswitch\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.600435    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600444    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-run-openvswitch\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600464    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-tmp\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600477    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-cnibin\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.600501    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret podName:6ed4e2f3-2b63-42f8-a843-ab87e02ea905 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:02.100477368 +0000 UTC m=+2.986805813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret") pod "global-pull-secret-syncer-8dchf" (UID: "6ed4e2f3-2b63-42f8-a843-ab87e02ea905") : object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntltm\" (UniqueName: \"kubernetes.io/projected/2ceee6ed-cf02-4553-88c2-ffdfe0023c33-kube-api-access-ntltm\") pod \"iptables-alerter-6fpgs\" (UID: \"2ceee6ed-cf02-4553-88c2-ffdfe0023c33\") " pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600561    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-host\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.600660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600608    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/11b51a67-54b6-403b-896b-d9c44784d6eb-hosts-file\") pod \"node-resolver-fr6nj\" (UID: \"11b51a67-54b6-403b-896b-d9c44784d6eb\") " pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11b51a67-54b6-403b-896b-d9c44784d6eb-tmp-dir\") pod \"node-resolver-fr6nj\" (UID: \"11b51a67-54b6-403b-896b-d9c44784d6eb\") " pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-kubelet\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600656    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-run-systemd\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600670    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-run-ovn\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600685    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-cni-netd\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600699    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-log-socket\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600720    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-cni-bin\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600743    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01757aa1-aae7-49d5-a04f-a071a1e659eb-ovnkube-config\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600771    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32799c08-ecb0-4c70-accb-1a420eab06d4-serviceca\") pod \"node-ca-w5jl6\" (UID: \"32799c08-ecb0-4c70-accb-1a420eab06d4\") " pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600793    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce32525a-a080-4032-808a-be6c753b90d6-cni-binary-copy\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600813    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/222b3c47-0737-4132-ab88-e8f4d773cbec-agent-certs\") pod \"konnectivity-agent-4glt4\" (UID: \"222b3c47-0737-4132-ab88-e8f4d773cbec\") " pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600833    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-run-netns\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ceee6ed-cf02-4553-88c2-ffdfe0023c33-iptables-alerter-script\") pod \"iptables-alerter-6fpgs\" (UID: \"2ceee6ed-cf02-4553-88c2-ffdfe0023c33\") " pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600885    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-system-cni-dir\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600909    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-os-release\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.601353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600933    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600940    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-cnibin\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600950    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa302717-cab9-45f2-8638-40c2192c4ac2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.600985    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-run-netns\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601130    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601136    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/11b51a67-54b6-403b-896b-d9c44784d6eb-hosts-file\") pod \"node-resolver-fr6nj\" (UID: \"11b51a67-54b6-403b-896b-d9c44784d6eb\") " pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601153    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-systemd\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-lib-modules\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/222b3c47-0737-4132-ab88-e8f4d773cbec-konnectivity-ca\") pod \"konnectivity-agent-4glt4\" (UID: \"222b3c47-0737-4132-ab88-e8f4d773cbec\") " pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-etc-selinux\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601281    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-sysctl-d\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-tuned\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601313    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjb2h\" (UniqueName: \"kubernetes.io/projected/d639c716-fe87-49b7-88b7-7c07ea4a7199-kube-api-access-rjb2h\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601328    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01757aa1-aae7-49d5-a04f-a071a1e659eb-env-overrides\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601343    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-hostroot\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-systemd-units\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.601995 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-var-lib-openvswitch\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601435    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01757aa1-aae7-49d5-a04f-a071a1e659eb-ovn-node-metrics-cert\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601438    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11b51a67-54b6-403b-896b-d9c44784d6eb-tmp-dir\") pod \"node-resolver-fr6nj\" (UID: \"11b51a67-54b6-403b-896b-d9c44784d6eb\") " pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-modprobe-d\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601480    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-multus-cni-dir\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601507    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-multus-socket-dir-parent\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601515    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-run-systemd\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601522    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-var-lib-cni-bin\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601484    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-kubelet\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-etc-kubernetes\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-var-lib-kubelet\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601686    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-var-lib-kubelet\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601711    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce32525a-a080-4032-808a-be6c753b90d6-multus-daemon-config\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601729    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndg8v\" (UniqueName: \"kubernetes.io/projected/ce32525a-a080-4032-808a-be6c753b90d6-kube-api-access-ndg8v\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-kubelet-config\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-cnibin\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601802    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-system-cni-dir\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601818    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28dqf\" (UniqueName: \"kubernetes.io/projected/32799c08-ecb0-4c70-accb-1a420eab06d4-kube-api-access-28dqf\") pod \"node-ca-w5jl6\" (UID: \"32799c08-ecb0-4c70-accb-1a420eab06d4\") " pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.602700 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-run-multus-certs\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601866    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnwhb\" (UniqueName: \"kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb\") pod \"network-check-target-mwgl4\" (UID: \"1c651d13-8367-40a6-8f81-b65d81a8b4d8\") " pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32799c08-ecb0-4c70-accb-1a420eab06d4-host\") pod \"node-ca-w5jl6\" (UID: \"32799c08-ecb0-4c70-accb-1a420eab06d4\") " pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnl44\" (UniqueName: \"kubernetes.io/projected/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-kube-api-access-bnl44\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-var-lib-cni-multus\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.601976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa302717-cab9-45f2-8638-40c2192c4ac2-cni-binary-copy\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-socket-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-kubernetes\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602047    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-sysctl-conf\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-run\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602085    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-dbus\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602232    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-dbus\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602271    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-run-ovn\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602304    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-var-lib-cni-bin\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602330    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-run-netns\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602680    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-sysctl-d\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602739    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-sys\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602796    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-os-release\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.603723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602832    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-multus-conf-dir\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.602851    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01757aa1-aae7-49d5-a04f-a071a1e659eb-ovnkube-script-lib\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.602915    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.602967    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs podName:1ed5d7d8-00c5-464f-a9ca-ba56adfd186e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:02.10294975 +0000 UTC m=+2.989278197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs") pod "network-metrics-daemon-bd4gd" (UID: "1ed5d7d8-00c5-464f-a9ca-ba56adfd186e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603005    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-slash\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603050    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-sysconfig\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603084    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603093    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-sys-fs\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603128    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-run-k8s-cni-cncf-io\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603176    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-registration-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603217    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-device-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603474    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-etc-openvswitch\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603521    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-run-openvswitch\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603533    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-cni-bin\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603574    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-host\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603602    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-etc-selinux\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603937    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-lib-modules\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603992    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-systemd\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.604683 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.603953    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-cni-netd\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604077    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604046    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-log-socket\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604108    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01757aa1-aae7-49d5-a04f-a071a1e659eb-ovnkube-config\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604115    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-run-netns\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32799c08-ecb0-4c70-accb-1a420eab06d4-serviceca\") pod \"node-ca-w5jl6\" (UID: \"32799c08-ecb0-4c70-accb-1a420eab06d4\") " pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604250    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32799c08-ecb0-4c70-accb-1a420eab06d4-host\") pod \"node-ca-w5jl6\" (UID: \"32799c08-ecb0-4c70-accb-1a420eab06d4\") " pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604306    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-kubelet-config\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604381    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-system-cni-dir\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604483    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01757aa1-aae7-49d5-a04f-a071a1e659eb-env-overrides\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604535    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-hostroot\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604575    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-systemd-units\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604618    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01757aa1-aae7-49d5-a04f-a071a1e659eb-var-lib-openvswitch\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604658    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-run-multus-certs\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604668    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce32525a-a080-4032-808a-be6c753b90d6-cni-binary-copy\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-multus-socket-dir-parent\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.604947    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-etc-kubernetes\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.605002    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-var-lib-kubelet\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.605928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.605043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-var-lib-kubelet\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.606822 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.605164    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-modprobe-d\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.606822 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.606013    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-sysctl-conf\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.606822 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.606412    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-kubernetes\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.606822 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.606469    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-host-var-lib-cni-multus\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.606822 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.606516    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce32525a-a080-4032-808a-be6c753b90d6-multus-daemon-config\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.606822 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.606638    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d639c716-fe87-49b7-88b7-7c07ea4a7199-socket-dir\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.606822 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.606819    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-run\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.607232 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.607192    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01757aa1-aae7-49d5-a04f-a071a1e659eb-ovn-node-metrics-cert\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.611609 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.608104    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-etc-tuned\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.611609 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.610317    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce32525a-a080-4032-808a-be6c753b90d6-multus-cni-dir\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.611609 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.610617    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-tmp\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.611609 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.611343    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm2cw\" (UniqueName: \"kubernetes.io/projected/01757aa1-aae7-49d5-a04f-a071a1e659eb-kube-api-access-vm2cw\") pod \"ovnkube-node-kdctm\" (UID: \"01757aa1-aae7-49d5-a04f-a071a1e659eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.612844 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.612817    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k6tc\" (UniqueName: \"kubernetes.io/projected/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-kube-api-access-5k6tc\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:01.614707 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.614687    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztf9m\" (UniqueName: \"kubernetes.io/projected/11b51a67-54b6-403b-896b-d9c44784d6eb-kube-api-access-ztf9m\") pod \"node-resolver-fr6nj\" (UID: \"11b51a67-54b6-403b-896b-d9c44784d6eb\") " pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.615537 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.615496    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndg8v\" (UniqueName: \"kubernetes.io/projected/ce32525a-a080-4032-808a-be6c753b90d6-kube-api-access-ndg8v\") pod \"multus-bnjh9\" (UID: \"ce32525a-a080-4032-808a-be6c753b90d6\") " pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.615771 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.615752    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28dqf\" (UniqueName: \"kubernetes.io/projected/32799c08-ecb0-4c70-accb-1a420eab06d4-kube-api-access-28dqf\") pod \"node-ca-w5jl6\" (UID: \"32799c08-ecb0-4c70-accb-1a420eab06d4\") " pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.621622 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.621602    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjb2h\" (UniqueName: \"kubernetes.io/projected/d639c716-fe87-49b7-88b7-7c07ea4a7199-kube-api-access-rjb2h\") pod \"aws-ebs-csi-driver-node-fnftm\" (UID: \"d639c716-fe87-49b7-88b7-7c07ea4a7199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.621823 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.621807    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnl44\" (UniqueName: \"kubernetes.io/projected/fc36fd05-62cd-4eb7-8fb3-4d571f13d08e-kube-api-access-bnl44\") pod \"tuned-hn5rg\" (UID: \"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e\") " pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.702971 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.702942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ceee6ed-cf02-4553-88c2-ffdfe0023c33-host-slash\") pod \"iptables-alerter-6fpgs\" (UID: \"2ceee6ed-cf02-4553-88c2-ffdfe0023c33\") " pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.703150 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.702987    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa302717-cab9-45f2-8638-40c2192c4ac2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703150 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703021    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ceee6ed-cf02-4553-88c2-ffdfe0023c33-host-slash\") pod \"iptables-alerter-6fpgs\" (UID: \"2ceee6ed-cf02-4553-88c2-ffdfe0023c33\") " pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.703150 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntltm\" (UniqueName: \"kubernetes.io/projected/2ceee6ed-cf02-4553-88c2-ffdfe0023c33-kube-api-access-ntltm\") pod \"iptables-alerter-6fpgs\" (UID: \"2ceee6ed-cf02-4553-88c2-ffdfe0023c33\") " pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.703150 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/222b3c47-0737-4132-ab88-e8f4d773cbec-agent-certs\") pod \"konnectivity-agent-4glt4\" (UID: \"222b3c47-0737-4132-ab88-e8f4d773cbec\") " pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:01.703150 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ceee6ed-cf02-4553-88c2-ffdfe0023c33-iptables-alerter-script\") pod \"iptables-alerter-6fpgs\" (UID: \"2ceee6ed-cf02-4553-88c2-ffdfe0023c33\") " pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.703150 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703114    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-system-cni-dir\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703150 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703143    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-os-release\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703510 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703163    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703510 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703183    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa302717-cab9-45f2-8638-40c2192c4ac2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703510 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703236    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-system-cni-dir\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703510 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703297    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-os-release\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703510 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703407    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703510 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/222b3c47-0737-4132-ab88-e8f4d773cbec-konnectivity-ca\") pod \"konnectivity-agent-4glt4\" (UID: \"222b3c47-0737-4132-ab88-e8f4d773cbec\") " pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:01.703510 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-cnibin\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703876 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwhb\" (UniqueName: \"kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb\") pod \"network-check-target-mwgl4\" (UID: \"1c651d13-8367-40a6-8f81-b65d81a8b4d8\") " pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:01.703876 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa302717-cab9-45f2-8638-40c2192c4ac2-cnibin\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703876 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa302717-cab9-45f2-8638-40c2192c4ac2-cni-binary-copy\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703876 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703685    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r528t\" (UniqueName: \"kubernetes.io/projected/aa302717-cab9-45f2-8638-40c2192c4ac2-kube-api-access-r528t\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703876 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703686    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa302717-cab9-45f2-8638-40c2192c4ac2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.703876 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703725    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ceee6ed-cf02-4553-88c2-ffdfe0023c33-iptables-alerter-script\") pod \"iptables-alerter-6fpgs\" (UID: \"2ceee6ed-cf02-4553-88c2-ffdfe0023c33\") " pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.704086 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.703891    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa302717-cab9-45f2-8638-40c2192c4ac2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.704120 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.704110    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa302717-cab9-45f2-8638-40c2192c4ac2-cni-binary-copy\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.704207 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.704178    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/222b3c47-0737-4132-ab88-e8f4d773cbec-konnectivity-ca\") pod \"konnectivity-agent-4glt4\" (UID: \"222b3c47-0737-4132-ab88-e8f4d773cbec\") " pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:01.705881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.705860    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/222b3c47-0737-4132-ab88-e8f4d773cbec-agent-certs\") pod \"konnectivity-agent-4glt4\" (UID: \"222b3c47-0737-4132-ab88-e8f4d773cbec\") " pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:01.709715 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.709517    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 03 23:30:01.709715 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.709544    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 03 23:30:01.709715 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.709557    2568 projected.go:196] Error preparing data for projected volume kube-api-access-nnwhb for pod openshift-network-diagnostics/network-check-target-mwgl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:01.709715 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:01.709687    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb podName:1c651d13-8367-40a6-8f81-b65d81a8b4d8 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:02.209661373 +0000 UTC m=+3.095989829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nnwhb" (UniqueName: "kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb") pod "network-check-target-mwgl4" (UID: "1c651d13-8367-40a6-8f81-b65d81a8b4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:01.712318 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.712247    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntltm\" (UniqueName: \"kubernetes.io/projected/2ceee6ed-cf02-4553-88c2-ffdfe0023c33-kube-api-access-ntltm\") pod \"iptables-alerter-6fpgs\" (UID: \"2ceee6ed-cf02-4553-88c2-ffdfe0023c33\") " pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.712669 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.712646    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r528t\" (UniqueName: \"kubernetes.io/projected/aa302717-cab9-45f2-8638-40c2192c4ac2-kube-api-access-r528t\") pod \"multus-additional-cni-plugins-rfhcj\" (UID: \"aa302717-cab9-45f2-8638-40c2192c4ac2\") " pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.764648 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.764565    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 03 23:30:01.800763 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.800714    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fr6nj"
Aug 03 23:30:01.809419 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.809388    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bnjh9"
Aug 03 23:30:01.814722 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.814695    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:01.820810 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.820782    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm"
Aug 03 23:30:01.827499 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.827476    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5jl6"
Aug 03 23:30:01.834028 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.834002    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hn5rg"
Aug 03 23:30:01.840932 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.840911    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6fpgs"
Aug 03 23:30:01.847518 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.847501    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rfhcj"
Aug 03 23:30:01.853342 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.853322    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:01.897357 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:01.897321    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 03 23:30:02.105874 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.105774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:02.105874 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.105829    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:02.106088 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:02.105926    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:02.106088 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:02.105957    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:02.106088 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:02.106008    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret podName:6ed4e2f3-2b63-42f8-a843-ab87e02ea905 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:03.105986295 +0000 UTC m=+3.992314755 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret") pod "global-pull-secret-syncer-8dchf" (UID: "6ed4e2f3-2b63-42f8-a843-ab87e02ea905") : object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:02.106088 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:02.106030    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs podName:1ed5d7d8-00c5-464f-a9ca-ba56adfd186e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:03.106019386 +0000 UTC m=+3.992347835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs") pod "network-metrics-daemon-bd4gd" (UID: "1ed5d7d8-00c5-464f-a9ca-ba56adfd186e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:02.307423 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.307386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwhb\" (UniqueName: \"kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb\") pod \"network-check-target-mwgl4\" (UID: \"1c651d13-8367-40a6-8f81-b65d81a8b4d8\") " pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:02.307608 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:02.307589    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 03 23:30:02.307658 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:02.307614    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 03 23:30:02.307658 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:02.307624    2568 projected.go:196] Error preparing data for projected volume kube-api-access-nnwhb for pod openshift-network-diagnostics/network-check-target-mwgl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:02.307732 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:02.307696    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb podName:1c651d13-8367-40a6-8f81-b65d81a8b4d8 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:03.3076648 +0000 UTC m=+4.193993258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnwhb" (UniqueName: "kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb") pod "network-check-target-mwgl4" (UID: "1c651d13-8367-40a6-8f81-b65d81a8b4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:02.516211 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:30:02.516177    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc36fd05_62cd_4eb7_8fb3_4d571f13d08e.slice/crio-89f4c9478ee288ab8ee699e14c7947cd849fa138bc98590a1cad6a50c8dfd362 WatchSource:0}: Error finding container 89f4c9478ee288ab8ee699e14c7947cd849fa138bc98590a1cad6a50c8dfd362: Status 404 returned error can't find the container with id 89f4c9478ee288ab8ee699e14c7947cd849fa138bc98590a1cad6a50c8dfd362
Aug 03 23:30:02.522811 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:30:02.522784    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd639c716_fe87_49b7_88b7_7c07ea4a7199.slice/crio-2eec12060ff44d65a2fd5b7a125f34d5d1c5f77dcaf8b6efb8ca2cdbbb4a322b WatchSource:0}: Error finding container 2eec12060ff44d65a2fd5b7a125f34d5d1c5f77dcaf8b6efb8ca2cdbbb4a322b: Status 404 returned error can't find the container with id 2eec12060ff44d65a2fd5b7a125f34d5d1c5f77dcaf8b6efb8ca2cdbbb4a322b
Aug 03 23:30:02.523790 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:30:02.523729    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01757aa1_aae7_49d5_a04f_a071a1e659eb.slice/crio-a631930271c1c2e9b82cbf30bf3cec9dac9c1ad539f7010a2dd9f47802221f1f WatchSource:0}: Error finding container a631930271c1c2e9b82cbf30bf3cec9dac9c1ad539f7010a2dd9f47802221f1f: Status 404 returned error can't find the container with id a631930271c1c2e9b82cbf30bf3cec9dac9c1ad539f7010a2dd9f47802221f1f
Aug 03 23:30:02.524573 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:30:02.524545    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce32525a_a080_4032_808a_be6c753b90d6.slice/crio-378ac901dacdc4f7e0989e762d51aeb2c6439108b1da32849117ef59162efec5 WatchSource:0}: Error finding container 378ac901dacdc4f7e0989e762d51aeb2c6439108b1da32849117ef59162efec5: Status 404 returned error can't find the container with id 378ac901dacdc4f7e0989e762d51aeb2c6439108b1da32849117ef59162efec5
Aug 03 23:30:02.528326 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:30:02.527395    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ceee6ed_cf02_4553_88c2_ffdfe0023c33.slice/crio-5b95d5aea9e3bab6939a9c6d2d8960cc89fbaf9e558c9fa5a16b44fae4848152 WatchSource:0}: Error finding container 5b95d5aea9e3bab6939a9c6d2d8960cc89fbaf9e558c9fa5a16b44fae4848152: Status 404 returned error can't find the container with id 5b95d5aea9e3bab6939a9c6d2d8960cc89fbaf9e558c9fa5a16b44fae4848152
Aug 03 23:30:02.529548 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:30:02.529526    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod222b3c47_0737_4132_ab88_e8f4d773cbec.slice/crio-f0d08bca5e3907546c6bb8e48fa0255c574bc173334ff9ab344e5e5dfb7a9ad5 WatchSource:0}: Error finding container f0d08bca5e3907546c6bb8e48fa0255c574bc173334ff9ab344e5e5dfb7a9ad5: Status 404 returned error can't find the container with id f0d08bca5e3907546c6bb8e48fa0255c574bc173334ff9ab344e5e5dfb7a9ad5
Aug 03 23:30:02.531171 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:30:02.531146    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa302717_cab9_45f2_8638_40c2192c4ac2.slice/crio-b8f24c087e5ea4f2b726278172bb9df06476392a4937e67511cd7f3aead5e3ae WatchSource:0}: Error finding container b8f24c087e5ea4f2b726278172bb9df06476392a4937e67511cd7f3aead5e3ae: Status 404 returned error can't find the container with id b8f24c087e5ea4f2b726278172bb9df06476392a4937e67511cd7f3aead5e3ae
Aug 03 23:30:02.536902 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.536879    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-02 23:25:01 +0000 UTC" deadline="2028-01-06 16:53:45.155149282 +0000 UTC"
Aug 03 23:30:02.536902 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.536902    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12497h23m42.618250418s"
Aug 03 23:30:02.654691 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.654090    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:02.654691 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:02.654240    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:02.654691 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.654293    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:02.654691 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:02.654390    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:02.667834 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.667802    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfhcj" event={"ID":"aa302717-cab9-45f2-8638-40c2192c4ac2","Type":"ContainerStarted","Data":"b8f24c087e5ea4f2b726278172bb9df06476392a4937e67511cd7f3aead5e3ae"}
Aug 03 23:30:02.668999 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.668966    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4glt4" event={"ID":"222b3c47-0737-4132-ab88-e8f4d773cbec","Type":"ContainerStarted","Data":"f0d08bca5e3907546c6bb8e48fa0255c574bc173334ff9ab344e5e5dfb7a9ad5"}
Aug 03 23:30:02.670180 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.670147    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bnjh9" event={"ID":"ce32525a-a080-4032-808a-be6c753b90d6","Type":"ContainerStarted","Data":"378ac901dacdc4f7e0989e762d51aeb2c6439108b1da32849117ef59162efec5"}
Aug 03 23:30:02.671509 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.671487    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm" event={"ID":"01757aa1-aae7-49d5-a04f-a071a1e659eb","Type":"ContainerStarted","Data":"a631930271c1c2e9b82cbf30bf3cec9dac9c1ad539f7010a2dd9f47802221f1f"}
Aug 03 23:30:02.673635 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.673609    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal" event={"ID":"b5fc83fdf27a40daf0d9c3c0b65f08da","Type":"ContainerStarted","Data":"e9d5ffa141a519043c3f37746e5cf82edd6286960277980c5b93b27c91057065"}
Aug 03 23:30:02.674802 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.674777    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6fpgs" event={"ID":"2ceee6ed-cf02-4553-88c2-ffdfe0023c33","Type":"ContainerStarted","Data":"5b95d5aea9e3bab6939a9c6d2d8960cc89fbaf9e558c9fa5a16b44fae4848152"}
Aug 03 23:30:02.676037 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.676017    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5jl6" event={"ID":"32799c08-ecb0-4c70-accb-1a420eab06d4","Type":"ContainerStarted","Data":"c1ae15a51f43a241bf8b03ccef24ebbfcfdc70130ffcd5099bda676ce9380de1"}
Aug 03 23:30:02.677236 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.677211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm" event={"ID":"d639c716-fe87-49b7-88b7-7c07ea4a7199","Type":"ContainerStarted","Data":"2eec12060ff44d65a2fd5b7a125f34d5d1c5f77dcaf8b6efb8ca2cdbbb4a322b"}
Aug 03 23:30:02.678307 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.678289    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fr6nj" event={"ID":"11b51a67-54b6-403b-896b-d9c44784d6eb","Type":"ContainerStarted","Data":"f5a854d6e700d5fb0fc316ddb02bec853bf93c146a7af9abdc74b7efb37e2b00"}
Aug 03 23:30:02.679287 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:02.679234    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hn5rg" event={"ID":"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e","Type":"ContainerStarted","Data":"89f4c9478ee288ab8ee699e14c7947cd849fa138bc98590a1cad6a50c8dfd362"}
Aug 03 23:30:03.113109 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:03.112969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:03.113109 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:03.113031    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:03.113353 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:03.113115    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:03.113353 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:03.113167    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:03.113353 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:03.113191    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret podName:6ed4e2f3-2b63-42f8-a843-ab87e02ea905 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:05.113170683 +0000 UTC m=+5.999499143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret") pod "global-pull-secret-syncer-8dchf" (UID: "6ed4e2f3-2b63-42f8-a843-ab87e02ea905") : object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:03.113353 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:03.113217    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs podName:1ed5d7d8-00c5-464f-a9ca-ba56adfd186e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:05.113201358 +0000 UTC m=+5.999529815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs") pod "network-metrics-daemon-bd4gd" (UID: "1ed5d7d8-00c5-464f-a9ca-ba56adfd186e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:03.314487 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:03.314442    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwhb\" (UniqueName: \"kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb\") pod \"network-check-target-mwgl4\" (UID: \"1c651d13-8367-40a6-8f81-b65d81a8b4d8\") " pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:03.314685 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:03.314618    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 03 23:30:03.314685 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:03.314638    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 03 23:30:03.314685 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:03.314652    2568 projected.go:196] Error preparing data for projected volume kube-api-access-nnwhb for pod openshift-network-diagnostics/network-check-target-mwgl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:03.314920 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:03.314710    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb podName:1c651d13-8367-40a6-8f81-b65d81a8b4d8 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:05.314691715 +0000 UTC m=+6.201020175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnwhb" (UniqueName: "kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb") pod "network-check-target-mwgl4" (UID: "1c651d13-8367-40a6-8f81-b65d81a8b4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:03.537659 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:03.537514    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-02 23:25:01 +0000 UTC" deadline="2028-03-05 16:54:43.786147662 +0000 UTC"
Aug 03 23:30:03.537659 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:03.537585    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13913h24m40.248567444s"
Aug 03 23:30:03.653896 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:03.653800    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:03.654729 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:03.654238    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:03.692642 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:03.692602    2568 generic.go:356] "Generic (PLEG): container finished" podID="d1339c26736d1236ea39fb7a5abb5e0e" containerID="92beceba315c417927f488467b40f84ed78df4a6a8861f9fdd4d278d0dc9f3b4" exitCode=0
Aug 03 23:30:03.700224 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:03.693649    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal" event={"ID":"d1339c26736d1236ea39fb7a5abb5e0e","Type":"ContainerDied","Data":"92beceba315c417927f488467b40f84ed78df4a6a8861f9fdd4d278d0dc9f3b4"}
Aug 03 23:30:03.709048 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:03.708943    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-58.ec2.internal" podStartSLOduration=2.708922338 podStartE2EDuration="2.708922338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:02.686940491 +0000 UTC m=+3.573268968" watchObservedRunningTime="2026-08-03 23:30:03.708922338 +0000 UTC m=+4.595250804"
Aug 03 23:30:04.654206 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:04.654170    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:04.654683 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:04.654333    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:04.654761 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:04.654739    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:04.654878 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:04.654857    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:04.714177 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:04.713504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal" event={"ID":"d1339c26736d1236ea39fb7a5abb5e0e","Type":"ContainerStarted","Data":"6295f1c60b87c007c15e2cf46a05c1da0ed585c46977cf6f5673dbc613dfbec5"}
Aug 03 23:30:04.729817 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:04.729733    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-58.ec2.internal" podStartSLOduration=4.729709934 podStartE2EDuration="4.729709934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:04.728936659 +0000 UTC m=+5.615265126" watchObservedRunningTime="2026-08-03 23:30:04.729709934 +0000 UTC m=+5.616038400"
Aug 03 23:30:05.127713 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:05.127607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:05.127713 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:05.127674    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:05.127942 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:05.127845    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:05.127942 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:05.127924    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs podName:1ed5d7d8-00c5-464f-a9ca-ba56adfd186e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:09.127900356 +0000 UTC m=+10.014228802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs") pod "network-metrics-daemon-bd4gd" (UID: "1ed5d7d8-00c5-464f-a9ca-ba56adfd186e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:05.128088 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:05.128002    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:05.128088 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:05.128041    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret podName:6ed4e2f3-2b63-42f8-a843-ab87e02ea905 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:09.128028603 +0000 UTC m=+10.014357049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret") pod "global-pull-secret-syncer-8dchf" (UID: "6ed4e2f3-2b63-42f8-a843-ab87e02ea905") : object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:05.329558 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:05.329494    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwhb\" (UniqueName: \"kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb\") pod \"network-check-target-mwgl4\" (UID: \"1c651d13-8367-40a6-8f81-b65d81a8b4d8\") " pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:05.329800 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:05.329719    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 03 23:30:05.329800 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:05.329745    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 03 23:30:05.329800 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:05.329759    2568 projected.go:196] Error preparing data for projected volume kube-api-access-nnwhb for pod openshift-network-diagnostics/network-check-target-mwgl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:05.329966 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:05.329820    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb podName:1c651d13-8367-40a6-8f81-b65d81a8b4d8 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:09.329801578 +0000 UTC m=+10.216130024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnwhb" (UniqueName: "kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb") pod "network-check-target-mwgl4" (UID: "1c651d13-8367-40a6-8f81-b65d81a8b4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:05.656176 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:05.656143    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:05.656639 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:05.656289    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:06.654451 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:06.654408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:06.654451 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:06.654446    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:06.654702 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:06.654590    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:06.654764 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:06.654742    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:07.654213 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:07.653723    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:07.654213 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:07.653853    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:08.654536 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:08.654501    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:08.655036 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:08.654501    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:08.655036 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:08.654659    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:08.655036 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:08.654724    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:09.167143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:09.166314    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:09.167143 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:09.166378    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:09.167143 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:09.166574    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:09.167143 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:09.166645    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs podName:1ed5d7d8-00c5-464f-a9ca-ba56adfd186e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:17.166623384 +0000 UTC m=+18.052951834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs") pod "network-metrics-daemon-bd4gd" (UID: "1ed5d7d8-00c5-464f-a9ca-ba56adfd186e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:09.167143 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:09.167052    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:09.167143 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:09.167107    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret podName:6ed4e2f3-2b63-42f8-a843-ab87e02ea905 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:17.167092564 +0000 UTC m=+18.053421009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret") pod "global-pull-secret-syncer-8dchf" (UID: "6ed4e2f3-2b63-42f8-a843-ab87e02ea905") : object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:09.367938 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:09.367886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwhb\" (UniqueName: \"kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb\") pod \"network-check-target-mwgl4\" (UID: \"1c651d13-8367-40a6-8f81-b65d81a8b4d8\") " pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:09.368121 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:09.368076    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 03 23:30:09.368121 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:09.368103    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 03 23:30:09.368121 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:09.368116    2568 projected.go:196] Error preparing data for projected volume kube-api-access-nnwhb for pod openshift-network-diagnostics/network-check-target-mwgl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:09.368231 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:09.368188    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb podName:1c651d13-8367-40a6-8f81-b65d81a8b4d8 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:17.36816192 +0000 UTC m=+18.254490383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnwhb" (UniqueName: "kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb") pod "network-check-target-mwgl4" (UID: "1c651d13-8367-40a6-8f81-b65d81a8b4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:09.655484 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:09.655402    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:09.656023 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:09.655520    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:10.654142 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:10.654101    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:10.654364 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:10.654113    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:10.654364 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:10.654254    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:10.654364 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:10.654293    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:11.655922 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:11.655883    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:11.656417 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:11.656020    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:12.654468 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:12.654437    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:12.654644 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:12.654493    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:12.654644 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:12.654584    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:12.654746 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:12.654701    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:13.654225 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:13.654187    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:13.654721 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:13.654348    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:14.654633 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:14.654595    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:14.654633 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:14.654619    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:14.655117 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:14.654743    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:14.655117 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:14.654864    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:15.654182 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:15.654152    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:15.654357 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:15.654297    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:16.653878 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:16.653841    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:16.654367 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:16.653887    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:16.654367 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:16.653978    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:16.654367 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:16.654154    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:17.231759 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:17.231714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:17.232045 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:17.231827    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:17.232045 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:17.231902    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:17.232045 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:17.231926    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:17.232045 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:17.231979    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret podName:6ed4e2f3-2b63-42f8-a843-ab87e02ea905 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:33.231963761 +0000 UTC m=+34.118292208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret") pod "global-pull-secret-syncer-8dchf" (UID: "6ed4e2f3-2b63-42f8-a843-ab87e02ea905") : object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:17.232045 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:17.231992    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs podName:1ed5d7d8-00c5-464f-a9ca-ba56adfd186e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:33.231985827 +0000 UTC m=+34.118314272 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs") pod "network-metrics-daemon-bd4gd" (UID: "1ed5d7d8-00c5-464f-a9ca-ba56adfd186e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:17.433507 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:17.433473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwhb\" (UniqueName: \"kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb\") pod \"network-check-target-mwgl4\" (UID: \"1c651d13-8367-40a6-8f81-b65d81a8b4d8\") " pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:17.433667 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:17.433640    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 03 23:30:17.433667 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:17.433659    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 03 23:30:17.433667 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:17.433669    2568 projected.go:196] Error preparing data for projected volume kube-api-access-nnwhb for pod openshift-network-diagnostics/network-check-target-mwgl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:17.433772 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:17.433720    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb podName:1c651d13-8367-40a6-8f81-b65d81a8b4d8 nodeName:}" failed. No retries permitted until 2026-08-03 23:30:33.433707193 +0000 UTC m=+34.320035649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnwhb" (UniqueName: "kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb") pod "network-check-target-mwgl4" (UID: "1c651d13-8367-40a6-8f81-b65d81a8b4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:17.653949 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:17.653865    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:17.654381 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:17.654012    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:18.654178 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:18.654143    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:18.654661 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:18.654160    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:18.654661 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:18.654326    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:18.654661 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:18.654361    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:19.654654 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:19.654614    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:19.655145 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:19.654738    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:20.654306 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:20.654252    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:20.654520 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:20.654276    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:20.654520 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:20.654410    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:20.654639 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:20.654541    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:21.656050 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.655840    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:21.656804 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:21.656146    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:21.757657 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.757440    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5jl6" event={"ID":"32799c08-ecb0-4c70-accb-1a420eab06d4","Type":"ContainerStarted","Data":"71794a7aaf61b4c17e59df599c48f887dd97deadab7574ffa89e45cd7091e062"}
Aug 03 23:30:21.759592 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.759560    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm" event={"ID":"d639c716-fe87-49b7-88b7-7c07ea4a7199","Type":"ContainerStarted","Data":"e61361690929b05d656f5496b088ba88c1b818e39694d3f6a1bff01b94eb047e"}
Aug 03 23:30:21.761102 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.761077    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fr6nj" event={"ID":"11b51a67-54b6-403b-896b-d9c44784d6eb","Type":"ContainerStarted","Data":"e8f7f10aac2dc24d65d79782d5733b3319f1fac49825da15986a42fe4cea719b"}
Aug 03 23:30:21.763008 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.762976    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hn5rg" event={"ID":"fc36fd05-62cd-4eb7-8fb3-4d571f13d08e","Type":"ContainerStarted","Data":"1d6ea8d76d1bde45caee99022686fa214901983c069c39bc58b7cc22046d763b"}
Aug 03 23:30:21.764638 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.764612    2568 generic.go:356] "Generic (PLEG): container finished" podID="aa302717-cab9-45f2-8638-40c2192c4ac2" containerID="69dd91a89f61c85fa68da944e83f73c1932f5d6414799751ec908bf1c29aed2e" exitCode=0
Aug 03 23:30:21.764732 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.764697    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfhcj" event={"ID":"aa302717-cab9-45f2-8638-40c2192c4ac2","Type":"ContainerDied","Data":"69dd91a89f61c85fa68da944e83f73c1932f5d6414799751ec908bf1c29aed2e"}
Aug 03 23:30:21.767569 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.767057    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4glt4" event={"ID":"222b3c47-0737-4132-ab88-e8f4d773cbec","Type":"ContainerStarted","Data":"9746c9cc87da299344f923eae7794cd57c0989fdf73b336572aafc0cdaff09e0"}
Aug 03 23:30:21.769673 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.769625    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bnjh9" event={"ID":"ce32525a-a080-4032-808a-be6c753b90d6","Type":"ContainerStarted","Data":"a205412c546c340cd6c230016f3c5fd28fca40ecefd658cad78b79a6a23e13bb"}
Aug 03 23:30:21.772107 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.772082    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm" event={"ID":"01757aa1-aae7-49d5-a04f-a071a1e659eb","Type":"ContainerStarted","Data":"2d21b016fd2d049cd9c4a2da88344301ece35363e8beeb6396974e553fbe7f4b"}
Aug 03 23:30:21.772698 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.772651    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w5jl6" podStartSLOduration=3.916904442 podStartE2EDuration="22.772634168s" totalImagesPullingTime="18.855729726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:21.772175669 +0000 UTC m=+22.658504134" watchObservedRunningTime="2026-08-03 23:30:21.772634168 +0000 UTC m=+22.658962654"
Aug 03 23:30:21.787822 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.787767    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hn5rg" podStartSLOduration=3.923736317 podStartE2EDuration="22.787752516s" totalImagesPullingTime="18.864016199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:21.787315305 +0000 UTC m=+22.673643770" watchObservedRunningTime="2026-08-03 23:30:21.787752516 +0000 UTC m=+22.674080980"
Aug 03 23:30:21.804416 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.804375    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fr6nj" podStartSLOduration=3.941475902 podStartE2EDuration="22.804359553s" totalImagesPullingTime="18.862883651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:21.803934833 +0000 UTC m=+22.690263299" watchObservedRunningTime="2026-08-03 23:30:21.804359553 +0000 UTC m=+22.690688018"
Aug 03 23:30:21.819698 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.819650    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bnjh9" podStartSLOduration=3.911857817 podStartE2EDuration="22.819635364s" totalImagesPullingTime="18.907777547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:21.819130741 +0000 UTC m=+22.705459205" watchObservedRunningTime="2026-08-03 23:30:21.819635364 +0000 UTC m=+22.705963828"
Aug 03 23:30:21.854916 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.854874    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4glt4" podStartSLOduration=8.070187739 podStartE2EDuration="22.854860624s" totalImagesPullingTime="14.784672885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:21.854501274 +0000 UTC m=+22.740829738" watchObservedRunningTime="2026-08-03 23:30:21.854860624 +0000 UTC m=+22.741189088"
Aug 03 23:30:21.952711 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:21.952670    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:22.033857 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:22.033831    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:22.653824 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:22.653781    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:22.653824 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:22.653809    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:22.654089 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:22.653951    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:22.654089 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:22.654073    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:22.777801 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:22.777755    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm" event={"ID":"01757aa1-aae7-49d5-a04f-a071a1e659eb","Type":"ContainerStarted","Data":"785b18a5c14116af34e18a380f47beae43643f3377ab8289e63b965e5997fed3"}
Aug 03 23:30:22.778414 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:22.777833    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm" event={"ID":"01757aa1-aae7-49d5-a04f-a071a1e659eb","Type":"ContainerStarted","Data":"c66b8166f56cf90bff1612e90737847f684c6435ab843728eab15891626e21d4"}
Aug 03 23:30:22.778414 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:22.777877    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm" event={"ID":"01757aa1-aae7-49d5-a04f-a071a1e659eb","Type":"ContainerStarted","Data":"bb87b9bffe37912b535d7a3136d9fa61839a9f163e4864bb4b8b1cab6e8bd0f7"}
Aug 03 23:30:22.778414 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:22.777907    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm" event={"ID":"01757aa1-aae7-49d5-a04f-a071a1e659eb","Type":"ContainerStarted","Data":"2faa3a622cfecc1592f7cfaa0e222f72da48aadb043ca52937c7b84bcc7278e4"}
Aug 03 23:30:22.778414 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:22.777935    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm" event={"ID":"01757aa1-aae7-49d5-a04f-a071a1e659eb","Type":"ContainerStarted","Data":"ae48f396d1eef3eb87eee014ac943d0e0ac2066ed3dd9e803fba5f1c79d4fcca"}
Aug 03 23:30:23.037159 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.037095    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 03 23:30:23.316398 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.316317    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:23.317091 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.317073    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:23.566553 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.566403    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-03T23:30:23.037116699Z","UUID":"9ac0eb8e-84cf-4f05-9f78-0dc7a9fe9b08","Handler":null,"Name":"","Endpoint":""}
Aug 03 23:30:23.568226 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.568202    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 03 23:30:23.568376 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.568246    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 03 23:30:23.654128 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.654095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:23.654336 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:23.654215    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:23.782703 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.782656    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm" event={"ID":"d639c716-fe87-49b7-88b7-7c07ea4a7199","Type":"ContainerStarted","Data":"bd03ae955d971f1b1b508caac80eae56538104939e17cefcf5b4f61f0abdae8b"}
Aug 03 23:30:23.784457 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.784425    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6fpgs" event={"ID":"2ceee6ed-cf02-4553-88c2-ffdfe0023c33","Type":"ContainerStarted","Data":"2ba7a71456575b6d8f373bb0bb675b445250e6148b3dedca97a675bbfdb5f24a"}
Aug 03 23:30:23.798828 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.798775    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6fpgs" podStartSLOduration=5.947838612 podStartE2EDuration="24.798757423s" totalImagesPullingTime="18.850918811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:23.798427685 +0000 UTC m=+24.684756152" watchObservedRunningTime="2026-08-03 23:30:23.798757423 +0000 UTC m=+24.685085889"
Aug 03 23:30:23.917948 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.917864    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:23.975164 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:23.975122    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:24.653817 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:24.653782    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:24.654027 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:24.653803    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:24.654027 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:24.653924    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:24.654119 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:24.654017    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:24.789074 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:24.789035    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm" event={"ID":"d639c716-fe87-49b7-88b7-7c07ea4a7199","Type":"ContainerStarted","Data":"1fe876f4d9c749976397aa4d9a1d4f3a688a70557ca1c6a84c6523daa3779ab0"}
Aug 03 23:30:24.792950 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:24.792920    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm" event={"ID":"01757aa1-aae7-49d5-a04f-a071a1e659eb","Type":"ContainerStarted","Data":"abc939ab19a4b7f1b0b8e0544edbfcb781bed9de403bad379dba4fd61ecb678c"}
Aug 03 23:30:24.792950 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:24.792949    2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 03 23:30:24.807439 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:24.807376    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnftm" podStartSLOduration=4.555419127 podStartE2EDuration="25.807345729s" totalImagesPullingTime="21.251926602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:24.805901217 +0000 UTC m=+25.692229674" watchObservedRunningTime="2026-08-03 23:30:24.807345729 +0000 UTC m=+25.693674190"
Aug 03 23:30:24.876525 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:24.876484    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:24.978323 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:24.978293    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:25.079360 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:25.079321    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:25.181386 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:25.181341    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:25.654220 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:25.654178    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:25.654434 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:25.654329    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:25.860308 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:25.860060    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:25.912477 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:25.912392    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:26.262276 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.262231    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:26.314784 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.314754    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:26.654502 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.654469    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:26.654633 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.654478    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:26.654633 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:26.654618    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:26.654757 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:26.654707    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:26.799247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.799166    2568 generic.go:356] "Generic (PLEG): container finished" podID="aa302717-cab9-45f2-8638-40c2192c4ac2" containerID="0413487dd841ac5204e05d8a8f5760823482f1922755d0ac076031c47a4d777e" exitCode=0
Aug 03 23:30:26.799414 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.799246    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfhcj" event={"ID":"aa302717-cab9-45f2-8638-40c2192c4ac2","Type":"ContainerDied","Data":"0413487dd841ac5204e05d8a8f5760823482f1922755d0ac076031c47a4d777e"}
Aug 03 23:30:26.805138 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.805110    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm" event={"ID":"01757aa1-aae7-49d5-a04f-a071a1e659eb","Type":"ContainerStarted","Data":"10e7631ed1e931c5b22d329058e747e2a4939ac25d5ca1bfc34fbbc0292643bf"}
Aug 03 23:30:26.805408 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.805389    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:26.805531 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.805448    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:26.821358 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.821328    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:26.837544 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.837510    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:26.847414 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.847370    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm" podStartSLOduration=8.911255517 podStartE2EDuration="27.847355579s" totalImagesPullingTime="18.936100062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:26.847158815 +0000 UTC m=+27.733487279" watchObservedRunningTime="2026-08-03 23:30:26.847355579 +0000 UTC m=+27.733684114"
Aug 03 23:30:26.894970 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:26.894929    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:27.328047 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:27.328015    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:27.328216 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:27.328187    2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 03 23:30:27.328619 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:27.328596    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4glt4"
Aug 03 23:30:27.389678 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:27.389504    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:27.654283 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:27.654186    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:27.654459 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:27.654305    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:27.808085 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:27.808061    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:27.823901 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:27.823872    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:28.251881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.251850    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:28.653896 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.653857    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:28.653896 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.653899    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:28.654149 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:28.653969    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:28.654149 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:28.654106    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:28.720316 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.720288    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8dchf"]
Aug 03 23:30:28.720492 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.720402    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:28.720557 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:28.720512    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:28.723595 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.723555    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bd4gd"]
Aug 03 23:30:28.724354 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.724331    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mwgl4"]
Aug 03 23:30:28.811773 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.811679    2568 generic.go:356] "Generic (PLEG): container finished" podID="aa302717-cab9-45f2-8638-40c2192c4ac2" containerID="6cfa42f925376262f6d6046d21b59f45715be743bc564a1c422afb7144279e34" exitCode=0
Aug 03 23:30:28.811773 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.811774    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:28.812009 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.811779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfhcj" event={"ID":"aa302717-cab9-45f2-8638-40c2192c4ac2","Type":"ContainerDied","Data":"6cfa42f925376262f6d6046d21b59f45715be743bc564a1c422afb7144279e34"}
Aug 03 23:30:28.812009 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:28.811837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:28.812009 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:28.811903    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:28.812354 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:28.812329    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:30.654316 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:30.654119    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:30.654691 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:30.654119    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:30.654691 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:30.654389    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:30.654691 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:30.654150    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:30.654691 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:30.654482    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:30.654691 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:30.654558    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:30.818527 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:30.818496    2568 generic.go:356] "Generic (PLEG): container finished" podID="aa302717-cab9-45f2-8638-40c2192c4ac2" containerID="dabf3bde98b00afcda28b6a00f51db48fc9c0716e7fb6ee1e16e72ae3bfe6984" exitCode=0
Aug 03 23:30:30.818692 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:30.818557    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfhcj" event={"ID":"aa302717-cab9-45f2-8638-40c2192c4ac2","Type":"ContainerDied","Data":"dabf3bde98b00afcda28b6a00f51db48fc9c0716e7fb6ee1e16e72ae3bfe6984"}
Aug 03 23:30:31.107216 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:31.107138    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:31.209910 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:31.209868    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:31.801022 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:31.800985    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:31.851356 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:31.851320    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:32.654545 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:32.654508    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:32.654709 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:32.654621    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:32.654709 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:32.654685    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:30:32.654709 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:32.654695    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:32.654879 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:32.654813    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwgl4" podUID="1c651d13-8367-40a6-8f81-b65d81a8b4d8"
Aug 03 23:30:32.654941 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:32.654924    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dchf" podUID="6ed4e2f3-2b63-42f8-a843-ab87e02ea905"
Aug 03 23:30:33.246921 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:33.246886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:33.246921 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:33.246933    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:33.247433 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:33.247125    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:33.247433 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:33.247125    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:33.247433 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:33.247201    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs podName:1ed5d7d8-00c5-464f-a9ca-ba56adfd186e nodeName:}" failed. No retries permitted until 2026-08-03 23:31:05.247175912 +0000 UTC m=+66.133504358 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs") pod "network-metrics-daemon-bd4gd" (UID: "1ed5d7d8-00c5-464f-a9ca-ba56adfd186e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 03 23:30:33.247433 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:33.247222    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret podName:6ed4e2f3-2b63-42f8-a843-ab87e02ea905 nodeName:}" failed. No retries permitted until 2026-08-03 23:31:05.247211402 +0000 UTC m=+66.133539845 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret") pod "global-pull-secret-syncer-8dchf" (UID: "6ed4e2f3-2b63-42f8-a843-ab87e02ea905") : object "kube-system"/"original-pull-secret" not registered
Aug 03 23:30:33.448510 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:33.448475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwhb\" (UniqueName: \"kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb\") pod \"network-check-target-mwgl4\" (UID: \"1c651d13-8367-40a6-8f81-b65d81a8b4d8\") " pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:33.448677 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:33.448638    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 03 23:30:33.448677 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:33.448656    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 03 23:30:33.448677 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:33.448666    2568 projected.go:196] Error preparing data for projected volume kube-api-access-nnwhb for pod openshift-network-diagnostics/network-check-target-mwgl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:33.448801 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:33.448721    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb podName:1c651d13-8367-40a6-8f81-b65d81a8b4d8 nodeName:}" failed. No retries permitted until 2026-08-03 23:31:05.448706902 +0000 UTC m=+66.335035344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnwhb" (UniqueName: "kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb") pod "network-check-target-mwgl4" (UID: "1c651d13-8367-40a6-8f81-b65d81a8b4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 03 23:30:34.404794 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.404763    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-58.ec2.internal" event="NodeReady"
Aug 03 23:30:34.405390 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.404916    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 03 23:30:34.445904 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.445867    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nlkm9"]
Aug 03 23:30:34.474918 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.474870    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wcx2p"]
Aug 03 23:30:34.475111 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.475003    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.477861 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.477607    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 03 23:30:34.477861 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.477701    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rmmw5\""
Aug 03 23:30:34.477861 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.477616    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 03 23:30:34.488562 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.488536    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nlkm9"]
Aug 03 23:30:34.488709 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.488584    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wcx2p"]
Aug 03 23:30:34.488709 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.488671    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wcx2p"
Aug 03 23:30:34.491012 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.490976    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 03 23:30:34.491222 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.491203    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 03 23:30:34.491378 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.491224    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4skmh\""
Aug 03 23:30:34.491447 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.491419    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 03 23:30:34.557603 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.557564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b80e13a-d7dd-4513-8219-c98d1017b80e-tmp-dir\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.557779 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.557628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b80e13a-d7dd-4513-8219-c98d1017b80e-config-volume\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.557779 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.557652    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.557779 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.557678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd552\" (UniqueName: \"kubernetes.io/projected/9b80e13a-d7dd-4513-8219-c98d1017b80e-kube-api-access-sd552\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.557779 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.557745    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30cb2a44-bdd0-487a-bd70-71ed0c06ecf8-cert\") pod \"ingress-canary-wcx2p\" (UID: \"30cb2a44-bdd0-487a-bd70-71ed0c06ecf8\") " pod="openshift-ingress-canary/ingress-canary-wcx2p"
Aug 03 23:30:34.557987 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.557790    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzccb\" (UniqueName: \"kubernetes.io/projected/30cb2a44-bdd0-487a-bd70-71ed0c06ecf8-kube-api-access-kzccb\") pod \"ingress-canary-wcx2p\" (UID: \"30cb2a44-bdd0-487a-bd70-71ed0c06ecf8\") " pod="openshift-ingress-canary/ingress-canary-wcx2p"
Aug 03 23:30:34.563889 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.563852    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:34.654043 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.654006    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:30:34.654426 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.654412    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:30:34.654744 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.654722    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:30:34.656885 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.656816    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 03 23:30:34.656885 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.656826    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 03 23:30:34.657005 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.656939    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6szp\""
Aug 03 23:30:34.657005 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.656995    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 03 23:30:34.657091 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.656939    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 03 23:30:34.657212 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.657194    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n4wm4\""
Aug 03 23:30:34.658512 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.658488    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30cb2a44-bdd0-487a-bd70-71ed0c06ecf8-cert\") pod \"ingress-canary-wcx2p\" (UID: \"30cb2a44-bdd0-487a-bd70-71ed0c06ecf8\") " pod="openshift-ingress-canary/ingress-canary-wcx2p"
Aug 03 23:30:34.658641 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.658531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzccb\" (UniqueName: \"kubernetes.io/projected/30cb2a44-bdd0-487a-bd70-71ed0c06ecf8-kube-api-access-kzccb\") pod \"ingress-canary-wcx2p\" (UID: \"30cb2a44-bdd0-487a-bd70-71ed0c06ecf8\") " pod="openshift-ingress-canary/ingress-canary-wcx2p"
Aug 03 23:30:34.658641 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.658567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b80e13a-d7dd-4513-8219-c98d1017b80e-tmp-dir\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.658641 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.658607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b80e13a-d7dd-4513-8219-c98d1017b80e-config-volume\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.658641 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.658631    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.658835 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.658668    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd552\" (UniqueName: \"kubernetes.io/projected/9b80e13a-d7dd-4513-8219-c98d1017b80e-kube-api-access-sd552\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.659042 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.659020    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b80e13a-d7dd-4513-8219-c98d1017b80e-tmp-dir\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.659142 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:34.659062    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 03 23:30:34.659142 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:34.659131    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls podName:9b80e13a-d7dd-4513-8219-c98d1017b80e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:35.159108194 +0000 UTC m=+36.045436638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls") pod "dns-default-nlkm9" (UID: "9b80e13a-d7dd-4513-8219-c98d1017b80e") : secret "dns-default-metrics-tls" not found
Aug 03 23:30:34.659375 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.659354    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b80e13a-d7dd-4513-8219-c98d1017b80e-config-volume\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.663791 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.663773    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30cb2a44-bdd0-487a-bd70-71ed0c06ecf8-cert\") pod \"ingress-canary-wcx2p\" (UID: \"30cb2a44-bdd0-487a-bd70-71ed0c06ecf8\") " pod="openshift-ingress-canary/ingress-canary-wcx2p"
Aug 03 23:30:34.667531 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.667508    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd552\" (UniqueName: \"kubernetes.io/projected/9b80e13a-d7dd-4513-8219-c98d1017b80e-kube-api-access-sd552\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:34.670047 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.670013    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzccb\" (UniqueName: \"kubernetes.io/projected/30cb2a44-bdd0-487a-bd70-71ed0c06ecf8-kube-api-access-kzccb\") pod \"ingress-canary-wcx2p\" (UID: \"30cb2a44-bdd0-487a-bd70-71ed0c06ecf8\") " pod="openshift-ingress-canary/ingress-canary-wcx2p"
Aug 03 23:30:34.798572 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:34.798535    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wcx2p"
Aug 03 23:30:35.162340 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:35.162297    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:35.162529 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:35.162433    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 03 23:30:35.162529 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:35.162502    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls podName:9b80e13a-d7dd-4513-8219-c98d1017b80e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:36.162486141 +0000 UTC m=+37.048814606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls") pod "dns-default-nlkm9" (UID: "9b80e13a-d7dd-4513-8219-c98d1017b80e") : secret "dns-default-metrics-tls" not found
Aug 03 23:30:35.469383 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:35.469348    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:35.524990 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:35.524806    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:35.562420 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:35.562382    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wcx2p"]
Aug 03 23:30:35.646347 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:30:35.646309    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30cb2a44_bdd0_487a_bd70_71ed0c06ecf8.slice/crio-9e15e3047b5d2c04d103a2f688842695d403b5b07453c0a6cc6416d9eb3f8d33 WatchSource:0}: Error finding container 9e15e3047b5d2c04d103a2f688842695d403b5b07453c0a6cc6416d9eb3f8d33: Status 404 returned error can't find the container with id 9e15e3047b5d2c04d103a2f688842695d403b5b07453c0a6cc6416d9eb3f8d33
Aug 03 23:30:35.834218 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:35.834167    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wcx2p" event={"ID":"30cb2a44-bdd0-487a-bd70-71ed0c06ecf8","Type":"ContainerStarted","Data":"9e15e3047b5d2c04d103a2f688842695d403b5b07453c0a6cc6416d9eb3f8d33"}
Aug 03 23:30:35.837182 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:35.837154    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfhcj" event={"ID":"aa302717-cab9-45f2-8638-40c2192c4ac2","Type":"ContainerStarted","Data":"0d2b2977e2193a941b2b9a51e3c867659137f5eefec446fd56860429b6084d9d"}
Aug 03 23:30:36.169079 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:36.168991    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:36.169247 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:36.169124    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 03 23:30:36.169247 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:36.169186    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls podName:9b80e13a-d7dd-4513-8219-c98d1017b80e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:38.169169655 +0000 UTC m=+39.055498104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls") pod "dns-default-nlkm9" (UID: "9b80e13a-d7dd-4513-8219-c98d1017b80e") : secret "dns-default-metrics-tls" not found
Aug 03 23:30:36.842698 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:36.842666    2568 generic.go:356] "Generic (PLEG): container finished" podID="aa302717-cab9-45f2-8638-40c2192c4ac2" containerID="0d2b2977e2193a941b2b9a51e3c867659137f5eefec446fd56860429b6084d9d" exitCode=0
Aug 03 23:30:36.843102 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:36.842729    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfhcj" event={"ID":"aa302717-cab9-45f2-8638-40c2192c4ac2","Type":"ContainerDied","Data":"0d2b2977e2193a941b2b9a51e3c867659137f5eefec446fd56860429b6084d9d"}
Aug 03 23:30:37.847144 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:37.847107    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wcx2p" event={"ID":"30cb2a44-bdd0-487a-bd70-71ed0c06ecf8","Type":"ContainerStarted","Data":"11a15724b715435dc5a09cc3192c05ef47c91d0f0309356064a4f9bb7caa0435"}
Aug 03 23:30:37.850588 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:37.850556    2568 generic.go:356] "Generic (PLEG): container finished" podID="aa302717-cab9-45f2-8638-40c2192c4ac2" containerID="c66ddad6a9f9feee3c4ee2e24a12e25cfd3c583f3c7115a336c6730b7293af05" exitCode=0
Aug 03 23:30:37.850722 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:37.850593    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfhcj" event={"ID":"aa302717-cab9-45f2-8638-40c2192c4ac2","Type":"ContainerDied","Data":"c66ddad6a9f9feee3c4ee2e24a12e25cfd3c583f3c7115a336c6730b7293af05"}
Aug 03 23:30:37.863128 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:37.862968    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wcx2p" podStartSLOduration=1.748822084 podStartE2EDuration="3.862942877s" totalImagesPullingTime="2.114120793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:30:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:37.86133024 +0000 UTC m=+38.747658708" watchObservedRunningTime="2026-08-03 23:30:37.862942877 +0000 UTC m=+38.749271342"
Aug 03 23:30:38.186087 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:38.186051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:38.186216 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:38.186180    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 03 23:30:38.186253 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:38.186232    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls podName:9b80e13a-d7dd-4513-8219-c98d1017b80e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:42.18621878 +0000 UTC m=+43.072547223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls") pod "dns-default-nlkm9" (UID: "9b80e13a-d7dd-4513-8219-c98d1017b80e") : secret "dns-default-metrics-tls" not found
Aug 03 23:30:38.857867 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:38.857834    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfhcj" event={"ID":"aa302717-cab9-45f2-8638-40c2192c4ac2","Type":"ContainerStarted","Data":"fca1e313cee0b0d2726469046d22fd42eb9788d7665e3aeb699b2d1bf68199be"}
Aug 03 23:30:38.882185 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:38.882130    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rfhcj" podStartSLOduration=8.926154652 podStartE2EDuration="39.882111665s" totalImagesPullingTime="30.955957013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:30:38.881104317 +0000 UTC m=+39.767432792" watchObservedRunningTime="2026-08-03 23:30:38.882111665 +0000 UTC m=+39.768440188"
Aug 03 23:30:38.883948 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:38.883918    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:38.982960 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:38.982930    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:39.083802 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:39.083772    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:39.184035 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:39.183944    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:42.216829 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:42.216782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:42.217239 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:42.216912    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 03 23:30:42.217239 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:42.216972    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls podName:9b80e13a-d7dd-4513-8219-c98d1017b80e nodeName:}" failed. No retries permitted until 2026-08-03 23:30:50.216957761 +0000 UTC m=+51.103286216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls") pod "dns-default-nlkm9" (UID: "9b80e13a-d7dd-4513-8219-c98d1017b80e") : secret "dns-default-metrics-tls" not found
Aug 03 23:30:46.769519 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:46.769474    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:46.827057 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:46.827026    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:50.278067 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:50.278025    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:30:50.278540 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:50.278191    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 03 23:30:50.278540 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:30:50.278297    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls podName:9b80e13a-d7dd-4513-8219-c98d1017b80e nodeName:}" failed. No retries permitted until 2026-08-03 23:31:06.278256068 +0000 UTC m=+67.164584528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls") pod "dns-default-nlkm9" (UID: "9b80e13a-d7dd-4513-8219-c98d1017b80e") : secret "dns-default-metrics-tls" not found
Aug 03 23:30:52.112311 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:52.112252    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:52.167307 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:52.167246    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:30:59.830677 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:59.830646    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdctm"
Aug 03 23:30:59.938504 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:30:59.938456    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:31:00.037036 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:00.036997    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:31:05.283526 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.283478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:31:05.283526 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.283533    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:31:05.286493 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.286474    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 03 23:31:05.286540 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.286474    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 03 23:31:05.294482 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:31:05.294460    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 03 23:31:05.294549 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:31:05.294539    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs podName:1ed5d7d8-00c5-464f-a9ca-ba56adfd186e nodeName:}" failed. No retries permitted until 2026-08-03 23:32:09.294522081 +0000 UTC m=+130.180850537 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs") pod "network-metrics-daemon-bd4gd" (UID: "1ed5d7d8-00c5-464f-a9ca-ba56adfd186e") : secret "metrics-daemon-secret" not found
Aug 03 23:31:05.302054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.302026    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ed4e2f3-2b63-42f8-a843-ab87e02ea905-original-pull-secret\") pod \"global-pull-secret-syncer-8dchf\" (UID: \"6ed4e2f3-2b63-42f8-a843-ab87e02ea905\") " pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:31:05.485282 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.485207    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwhb\" (UniqueName: \"kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb\") pod \"network-check-target-mwgl4\" (UID: \"1c651d13-8367-40a6-8f81-b65d81a8b4d8\") " pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:31:05.487626 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.487611    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 03 23:31:05.498312 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.498294    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 03 23:31:05.509687 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.509659    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnwhb\" (UniqueName: \"kubernetes.io/projected/1c651d13-8367-40a6-8f81-b65d81a8b4d8-kube-api-access-nnwhb\") pod \"network-check-target-mwgl4\" (UID: \"1c651d13-8367-40a6-8f81-b65d81a8b4d8\") " pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:31:05.586085 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.585983    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dchf"
Aug 03 23:31:05.595082 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.595056    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n4wm4\""
Aug 03 23:31:05.603913 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.603889    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:31:05.725668 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.725626    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8dchf"]
Aug 03 23:31:05.729671 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:31:05.729631    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed4e2f3_2b63_42f8_a843_ab87e02ea905.slice/crio-eb94051f7ba159b0751fbd8485bf5437cbe594c95cb040a14406afba57d7027b WatchSource:0}: Error finding container eb94051f7ba159b0751fbd8485bf5437cbe594c95cb040a14406afba57d7027b: Status 404 returned error can't find the container with id eb94051f7ba159b0751fbd8485bf5437cbe594c95cb040a14406afba57d7027b
Aug 03 23:31:05.740873 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.740845    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mwgl4"]
Aug 03 23:31:05.744166 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:31:05.744136    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c651d13_8367_40a6_8f81_b65d81a8b4d8.slice/crio-a3a185baf753f600ff1915ac77f7b6a6d60986624a5559148fafec715d447dbd WatchSource:0}: Error finding container a3a185baf753f600ff1915ac77f7b6a6d60986624a5559148fafec715d447dbd: Status 404 returned error can't find the container with id a3a185baf753f600ff1915ac77f7b6a6d60986624a5559148fafec715d447dbd
Aug 03 23:31:05.924574 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.924478    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mwgl4" event={"ID":"1c651d13-8367-40a6-8f81-b65d81a8b4d8","Type":"ContainerStarted","Data":"a3a185baf753f600ff1915ac77f7b6a6d60986624a5559148fafec715d447dbd"}
Aug 03 23:31:05.925551 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:05.925531    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8dchf" event={"ID":"6ed4e2f3-2b63-42f8-a843-ab87e02ea905","Type":"ContainerStarted","Data":"eb94051f7ba159b0751fbd8485bf5437cbe594c95cb040a14406afba57d7027b"}
Aug 03 23:31:06.291172 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:06.291119    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:31:06.291681 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:31:06.291286    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 03 23:31:06.291681 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:31:06.291372    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls podName:9b80e13a-d7dd-4513-8219-c98d1017b80e nodeName:}" failed. No retries permitted until 2026-08-03 23:31:38.291355038 +0000 UTC m=+99.177683481 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls") pod "dns-default-nlkm9" (UID: "9b80e13a-d7dd-4513-8219-c98d1017b80e") : secret "dns-default-metrics-tls" not found
Aug 03 23:31:10.939892 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:10.939805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mwgl4" event={"ID":"1c651d13-8367-40a6-8f81-b65d81a8b4d8","Type":"ContainerStarted","Data":"4ea73c8fecf068bd2e268b80941ffa30a580a8c17e8dad05a3dc9adf433c0706"}
Aug 03 23:31:10.940356 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:10.939939    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:31:10.941328 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:10.941306    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8dchf" event={"ID":"6ed4e2f3-2b63-42f8-a843-ab87e02ea905","Type":"ContainerStarted","Data":"7c6f9a256c1fe0183f897401b991a1f50adaef59d0ed73bfa3e6ebd1fc751271"}
Aug 03 23:31:10.955829 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:10.955770    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mwgl4" podStartSLOduration=67.175779235 podStartE2EDuration="1m11.955745178s" totalImagesPullingTime="4.779965943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:31:10.95441584 +0000 UTC m=+71.840744305" watchObservedRunningTime="2026-08-03 23:31:10.955745178 +0000 UTC m=+71.842073703"
Aug 03 23:31:10.968821 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:10.968769    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8dchf" podStartSLOduration=67.166637602 podStartE2EDuration="1m11.968753936s" totalImagesPullingTime="4.802116334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:31:10.968311183 +0000 UTC m=+71.854639648" watchObservedRunningTime="2026-08-03 23:31:10.968753936 +0000 UTC m=+71.855082401"
Aug 03 23:31:24.712694 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.712583    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"]
Aug 03 23:31:24.714935 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.714913    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:24.718938 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.717574    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 03 23:31:24.718938 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.718684    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Aug 03 23:31:24.718938 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.718734    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 03 23:31:24.718938 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.718893    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 03 23:31:24.721790 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.721772    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"]
Aug 03 23:31:24.725038 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.724171    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.725038 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.724858    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"]
Aug 03 23:31:24.726438 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.726414    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Aug 03 23:31:24.726554 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.726487    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Aug 03 23:31:24.726554 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.726523    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Aug 03 23:31:24.726554 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.726546    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Aug 03 23:31:24.740364 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.740328    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"]
Aug 03 23:31:24.819546 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.819504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5f7d15e8-fa74-43bf-aa28-f2a86127fb67-klusterlet-config\") pod \"klusterlet-addon-workmgr-c5bc66f9c-rfncr\" (UID: \"5f7d15e8-fa74-43bf-aa28-f2a86127fb67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:24.819546 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.819547    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f7d15e8-fa74-43bf-aa28-f2a86127fb67-tmp\") pod \"klusterlet-addon-workmgr-c5bc66f9c-rfncr\" (UID: \"5f7d15e8-fa74-43bf-aa28-f2a86127fb67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:24.819759 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.819568    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzvz2\" (UniqueName: \"kubernetes.io/projected/5f7d15e8-fa74-43bf-aa28-f2a86127fb67-kube-api-access-kzvz2\") pod \"klusterlet-addon-workmgr-c5bc66f9c-rfncr\" (UID: \"5f7d15e8-fa74-43bf-aa28-f2a86127fb67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:24.819759 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.819642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.819759 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.819685    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.819759 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.819721    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6407076e-3cc8-474c-9e1c-96a4110d78f5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.819759 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.819747    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-ca\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.819914 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.819785    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-hub\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.819914 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.819857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwl6c\" (UniqueName: \"kubernetes.io/projected/6407076e-3cc8-474c-9e1c-96a4110d78f5-kube-api-access-zwl6c\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.920966 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.920918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.920966 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.920969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.921138 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.920998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6407076e-3cc8-474c-9e1c-96a4110d78f5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.921138 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.921025    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-ca\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.921234 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.921185    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-hub\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.921323 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.921249    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwl6c\" (UniqueName: \"kubernetes.io/projected/6407076e-3cc8-474c-9e1c-96a4110d78f5-kube-api-access-zwl6c\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.921380 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.921341    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5f7d15e8-fa74-43bf-aa28-f2a86127fb67-klusterlet-config\") pod \"klusterlet-addon-workmgr-c5bc66f9c-rfncr\" (UID: \"5f7d15e8-fa74-43bf-aa28-f2a86127fb67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:24.921380 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.921372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f7d15e8-fa74-43bf-aa28-f2a86127fb67-tmp\") pod \"klusterlet-addon-workmgr-c5bc66f9c-rfncr\" (UID: \"5f7d15e8-fa74-43bf-aa28-f2a86127fb67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:24.921479 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.921398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzvz2\" (UniqueName: \"kubernetes.io/projected/5f7d15e8-fa74-43bf-aa28-f2a86127fb67-kube-api-access-kzvz2\") pod \"klusterlet-addon-workmgr-c5bc66f9c-rfncr\" (UID: \"5f7d15e8-fa74-43bf-aa28-f2a86127fb67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:24.921890 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.921865    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6407076e-3cc8-474c-9e1c-96a4110d78f5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.922370 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.921914    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f7d15e8-fa74-43bf-aa28-f2a86127fb67-tmp\") pod \"klusterlet-addon-workmgr-c5bc66f9c-rfncr\" (UID: \"5f7d15e8-fa74-43bf-aa28-f2a86127fb67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:24.923935 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.923907    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-hub\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.924045 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.924007    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5f7d15e8-fa74-43bf-aa28-f2a86127fb67-klusterlet-config\") pod \"klusterlet-addon-workmgr-c5bc66f9c-rfncr\" (UID: \"5f7d15e8-fa74-43bf-aa28-f2a86127fb67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:24.924045 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.924027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.924045 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.924014    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.924158 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.924104    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6407076e-3cc8-474c-9e1c-96a4110d78f5-ca\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:24.930002 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.929976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzvz2\" (UniqueName: \"kubernetes.io/projected/5f7d15e8-fa74-43bf-aa28-f2a86127fb67-kube-api-access-kzvz2\") pod \"klusterlet-addon-workmgr-c5bc66f9c-rfncr\" (UID: \"5f7d15e8-fa74-43bf-aa28-f2a86127fb67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:24.930097 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:24.930060    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwl6c\" (UniqueName: \"kubernetes.io/projected/6407076e-3cc8-474c-9e1c-96a4110d78f5-kube-api-access-zwl6c\") pod \"cluster-proxy-proxy-agent-847fddc84c-vvdj6\" (UID: \"6407076e-3cc8-474c-9e1c-96a4110d78f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:25.027613 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:25.027556    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:25.046323 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:25.046297    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:31:25.162485 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:25.162452    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"]
Aug 03 23:31:25.168630 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:31:25.168593    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7d15e8_fa74_43bf_aa28_f2a86127fb67.slice/crio-6e923784c1b689158b59a99e97a3d7872c1958c54f727297802f3eb793705487 WatchSource:0}: Error finding container 6e923784c1b689158b59a99e97a3d7872c1958c54f727297802f3eb793705487: Status 404 returned error can't find the container with id 6e923784c1b689158b59a99e97a3d7872c1958c54f727297802f3eb793705487
Aug 03 23:31:25.181656 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:25.181626    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"]
Aug 03 23:31:25.184971 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:31:25.184936    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6407076e_3cc8_474c_9e1c_96a4110d78f5.slice/crio-04b3cd8d047277b6d8accaa42a169f9501930e64c372420b4c5d3a08c5c17639 WatchSource:0}: Error finding container 04b3cd8d047277b6d8accaa42a169f9501930e64c372420b4c5d3a08c5c17639: Status 404 returned error can't find the container with id 04b3cd8d047277b6d8accaa42a169f9501930e64c372420b4c5d3a08c5c17639
Aug 03 23:31:25.980777 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:25.980692    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" event={"ID":"6407076e-3cc8-474c-9e1c-96a4110d78f5","Type":"ContainerStarted","Data":"04b3cd8d047277b6d8accaa42a169f9501930e64c372420b4c5d3a08c5c17639"}
Aug 03 23:31:25.982621 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:25.982546    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr" event={"ID":"5f7d15e8-fa74-43bf-aa28-f2a86127fb67","Type":"ContainerStarted","Data":"6e923784c1b689158b59a99e97a3d7872c1958c54f727297802f3eb793705487"}
Aug 03 23:31:31.000333 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:31.000243    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" event={"ID":"6407076e-3cc8-474c-9e1c-96a4110d78f5","Type":"ContainerStarted","Data":"f6b8b30bcbe0b07f11f58f22dedd8d6c19a7cde58c8702ce4b89bbed2e4a8fb3"}
Aug 03 23:31:31.000333 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:31.000314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" event={"ID":"6407076e-3cc8-474c-9e1c-96a4110d78f5","Type":"ContainerStarted","Data":"46aa26023dc62b8e05046661faf93e2dfa2b322491add95881937ae48b5524f9"}
Aug 03 23:31:31.001676 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:31.001648    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr" event={"ID":"5f7d15e8-fa74-43bf-aa28-f2a86127fb67","Type":"ContainerStarted","Data":"0771a28b4a188bb2283c11f80040fe2fb388fbb6fd2521207bd8c061c7ba5123"}
Aug 03 23:31:31.001932 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:31.001914    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:31.003626 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:31.003315    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:31:31.018883 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:31.018839    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr" podStartSLOduration=1.347227881 podStartE2EDuration="7.018820056s" totalImagesPullingTime="5.671592175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:31:31.018282327 +0000 UTC m=+91.904610789" watchObservedRunningTime="2026-08-03 23:31:31.018820056 +0000 UTC m=+91.905148524"
Aug 03 23:31:32.007026 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:32.006991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" event={"ID":"6407076e-3cc8-474c-9e1c-96a4110d78f5","Type":"ContainerStarted","Data":"ea35f3ba59fafdf4a0b337d9e739b69d6523126f4210dfc47e40fdd36c181982"}
Aug 03 23:31:32.025414 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:32.025361    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" podStartSLOduration=2.36902054 podStartE2EDuration="8.025345641s" totalImagesPullingTime="5.656325101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:31:32.024714558 +0000 UTC m=+92.911043042" watchObservedRunningTime="2026-08-03 23:31:32.025345641 +0000 UTC m=+92.911674105"
Aug 03 23:31:38.325583 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:38.325526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:31:38.325909 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:31:38.325700    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 03 23:31:38.325909 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:31:38.325784    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls podName:9b80e13a-d7dd-4513-8219-c98d1017b80e nodeName:}" failed. No retries permitted until 2026-08-03 23:32:42.325764138 +0000 UTC m=+163.212092604 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls") pod "dns-default-nlkm9" (UID: "9b80e13a-d7dd-4513-8219-c98d1017b80e") : secret "dns-default-metrics-tls" not found
Aug 03 23:31:41.946021 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:41.945992    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mwgl4"
Aug 03 23:31:44.509204 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:44.509160    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:31:44.564190 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:31:44.564154    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:32:09.357897 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:32:09.357830    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:32:09.358423 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:32:09.357977    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 03 23:32:09.358423 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:32:09.358062    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs podName:1ed5d7d8-00c5-464f-a9ca-ba56adfd186e nodeName:}" failed. No retries permitted until 2026-08-03 23:34:11.358046255 +0000 UTC m=+252.244374698 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs") pod "network-metrics-daemon-bd4gd" (UID: "1ed5d7d8-00c5-464f-a9ca-ba56adfd186e") : secret "metrics-daemon-secret" not found
Aug 03 23:32:37.485923 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:32:37.485881    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nlkm9" podUID="9b80e13a-d7dd-4513-8219-c98d1017b80e"
Aug 03 23:32:37.677577 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:32:37.677532    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:32:38.194851 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:32:38.194821    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:32:42.391225 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:32:42.391178    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:32:42.391660 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:32:42.391337    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 03 23:32:42.391660 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:32:42.391411    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls podName:9b80e13a-d7dd-4513-8219-c98d1017b80e nodeName:}" failed. No retries permitted until 2026-08-03 23:34:44.391395267 +0000 UTC m=+285.277723710 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls") pod "dns-default-nlkm9" (UID: "9b80e13a-d7dd-4513-8219-c98d1017b80e") : secret "dns-default-metrics-tls" not found
Aug 03 23:32:49.654801 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:32:49.654760    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:33:31.002996 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:33:31.002943    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr" podUID="5f7d15e8-fa74-43bf-aa28-f2a86127fb67" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Aug 03 23:33:31.346791 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:33:31.346755    2568 generic.go:356] "Generic (PLEG): container finished" podID="5f7d15e8-fa74-43bf-aa28-f2a86127fb67" containerID="0771a28b4a188bb2283c11f80040fe2fb388fbb6fd2521207bd8c061c7ba5123" exitCode=1
Aug 03 23:33:31.346985 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:33:31.346838    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr" event={"ID":"5f7d15e8-fa74-43bf-aa28-f2a86127fb67","Type":"ContainerDied","Data":"0771a28b4a188bb2283c11f80040fe2fb388fbb6fd2521207bd8c061c7ba5123"}
Aug 03 23:33:31.347225 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:33:31.347209    2568 scope.go:117] "RemoveContainer" containerID="0771a28b4a188bb2283c11f80040fe2fb388fbb6fd2521207bd8c061c7ba5123"
Aug 03 23:33:32.351003 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:33:32.350971    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr" event={"ID":"5f7d15e8-fa74-43bf-aa28-f2a86127fb67","Type":"ContainerStarted","Data":"540fa26c507706369cf2736be8a01838291cc93a160328fa60558d9d73b50a22"}
Aug 03 23:33:32.351428 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:33:32.351286    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:33:32.351867 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:33:32.351850    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c5bc66f9c-rfncr"
Aug 03 23:33:43.676372 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:33:43.676340    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:07.064140 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:07.064108    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:07.165165 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:07.165130    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:09.274836 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:09.274805    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:10.820817 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:10.820782    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:10.914756 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:10.914721    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:11.014980 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.014947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:11.074834 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.074748    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:11.408167 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.408078    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:34:11.408369 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:11.408240    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 03 23:34:11.408369 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:11.408354    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs podName:1ed5d7d8-00c5-464f-a9ca-ba56adfd186e nodeName:}" failed. No retries permitted until 2026-08-03 23:36:13.408331764 +0000 UTC m=+374.294660208 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs") pod "network-metrics-daemon-bd4gd" (UID: "1ed5d7d8-00c5-464f-a9ca-ba56adfd186e") : secret "metrics-daemon-secret" not found
Aug 03 23:34:11.414767 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.414741    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:11.422895 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.422869    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cmqr7"]
Aug 03 23:34:11.424778 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.424760    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.426927 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.426906    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 03 23:34:11.427025 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.426906    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 03 23:34:11.427087 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.427061    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 03 23:34:11.427148 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.427128    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 03 23:34:11.427996 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.427976    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lglgl\""
Aug 03 23:34:11.439591 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.439570    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmqr7"]
Aug 03 23:34:11.479183 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.479155    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:11.609932 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.609895    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.609932 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.609932    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32142187-de54-4fef-82eb-c7b8c9296ff3-data-volume\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.610098 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.609953    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkthd\" (UniqueName: \"kubernetes.io/projected/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-api-access-xkthd\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.610098 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.609994    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.610098 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.610037    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32142187-de54-4fef-82eb-c7b8c9296ff3-crio-socket\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.692695 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.692621    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:11.710747 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.710717    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32142187-de54-4fef-82eb-c7b8c9296ff3-crio-socket\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.710828 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.710766    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.710828 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.710795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32142187-de54-4fef-82eb-c7b8c9296ff3-data-volume\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.710892 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.710823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkthd\" (UniqueName: \"kubernetes.io/projected/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-api-access-xkthd\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.710892 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.710839    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32142187-de54-4fef-82eb-c7b8c9296ff3-crio-socket\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.710892 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.710865    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.710987 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:11.710892    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 03 23:34:11.710987 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:11.710941    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 03 23:34:11.710987 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:11.710956    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls podName:32142187-de54-4fef-82eb-c7b8c9296ff3 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:12.210934339 +0000 UTC m=+253.097262783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmqr7" (UID: "32142187-de54-4fef-82eb-c7b8c9296ff3") : secret "insights-runtime-extractor-tls" not found
Aug 03 23:34:11.711079 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:11.710994    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm podName:32142187-de54-4fef-82eb-c7b8c9296ff3 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:12.21098166 +0000 UTC m=+253.097310122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmqr7" (UID: "32142187-de54-4fef-82eb-c7b8c9296ff3") : configmap "kube-rbac-proxy" not found
Aug 03 23:34:11.711178 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.711157    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32142187-de54-4fef-82eb-c7b8c9296ff3-data-volume\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.723537 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.723504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkthd\" (UniqueName: \"kubernetes.io/projected/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-api-access-xkthd\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:11.793381 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:11.793339    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:12.214338 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:12.214299    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:12.214730 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:12.214367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:12.214730 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:12.214453    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 03 23:34:12.214730 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:12.214491    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 03 23:34:12.214730 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:12.214520    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls podName:32142187-de54-4fef-82eb-c7b8c9296ff3 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:13.214504288 +0000 UTC m=+254.100832730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmqr7" (UID: "32142187-de54-4fef-82eb-c7b8c9296ff3") : secret "insights-runtime-extractor-tls" not found
Aug 03 23:34:12.214730 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:12.214551    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm podName:32142187-de54-4fef-82eb-c7b8c9296ff3 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:13.214537917 +0000 UTC m=+254.100866360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmqr7" (UID: "32142187-de54-4fef-82eb-c7b8c9296ff3") : configmap "kube-rbac-proxy" not found
Aug 03 23:34:13.222554 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:13.222514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:13.222934 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:13.222567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:13.222934 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:13.222634    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 03 23:34:13.222934 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:13.222673    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 03 23:34:13.222934 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:13.222687    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm podName:32142187-de54-4fef-82eb-c7b8c9296ff3 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:15.222673243 +0000 UTC m=+256.109001686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmqr7" (UID: "32142187-de54-4fef-82eb-c7b8c9296ff3") : configmap "kube-rbac-proxy" not found
Aug 03 23:34:13.222934 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:13.222745    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls podName:32142187-de54-4fef-82eb-c7b8c9296ff3 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:15.222727011 +0000 UTC m=+256.109055458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmqr7" (UID: "32142187-de54-4fef-82eb-c7b8c9296ff3") : secret "insights-runtime-extractor-tls" not found
Aug 03 23:34:13.299541 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:13.299508    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:13.353928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:13.353895    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:14.128894 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:14.128859    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:14.190436 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:14.190411    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fr6nj_11b51a67-54b6-403b-896b-d9c44784d6eb/dns-node-resolver/0.log"
Aug 03 23:34:15.065079 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:15.065044    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:15.190004 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:15.189972    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5jl6_32799c08-ecb0-4c70-accb-1a420eab06d4/node-ca/0.log"
Aug 03 23:34:15.218478 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:15.218447    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:15.237590 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:15.237559    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:15.237744 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:15.237609    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:15.237744 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:15.237698    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 03 23:34:15.237744 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:15.237714    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 03 23:34:15.237858 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:15.237748    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm podName:32142187-de54-4fef-82eb-c7b8c9296ff3 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:19.237735373 +0000 UTC m=+260.124063816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmqr7" (UID: "32142187-de54-4fef-82eb-c7b8c9296ff3") : configmap "kube-rbac-proxy" not found
Aug 03 23:34:15.237858 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:15.237766    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls podName:32142187-de54-4fef-82eb-c7b8c9296ff3 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:19.237752876 +0000 UTC m=+260.124081318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmqr7" (UID: "32142187-de54-4fef-82eb-c7b8c9296ff3") : secret "insights-runtime-extractor-tls" not found
Aug 03 23:34:15.319659 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:15.319575    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:15.419797 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:15.419758    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:15.519664 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:15.519632    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:15.760060 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:15.760028    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:16.190489 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:16.190421    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wcx2p_30cb2a44-bdd0-487a-bd70-71ed0c06ecf8/serve-healthcheck-canary/0.log"
Aug 03 23:34:16.330562 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:16.330534    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:16.561379 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:16.561353    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:17.159588 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:17.159555    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:17.362775 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:17.362740    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:17.761769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:17.761738    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:17.963319 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:17.963288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:18.369210 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:18.369180    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:18.937124 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:18.937091    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:18.986979 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:18.986952    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:19.271361 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:19.271316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:19.271540 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:19.271374    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:19.271540 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:19.271452    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 03 23:34:19.271540 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:19.271458    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 03 23:34:19.271540 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:19.271513    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls podName:32142187-de54-4fef-82eb-c7b8c9296ff3 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:27.271497446 +0000 UTC m=+268.157825889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmqr7" (UID: "32142187-de54-4fef-82eb-c7b8c9296ff3") : secret "insights-runtime-extractor-tls" not found
Aug 03 23:34:19.271540 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:19.271529    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm podName:32142187-de54-4fef-82eb-c7b8c9296ff3 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:27.271520454 +0000 UTC m=+268.157848896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmqr7" (UID: "32142187-de54-4fef-82eb-c7b8c9296ff3") : configmap "kube-rbac-proxy" not found
Aug 03 23:34:19.364487 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:19.364456    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:19.754644 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:19.754616    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:20.159831 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:20.159739    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:20.376016 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:20.375987    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:20.756797 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:20.756768    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:20.960175 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:20.960146    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:21.556908 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:21.556867    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:21.611753 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:21.611720    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:21.759746 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:21.759715    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:22.157228 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:22.157193    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:22.383992 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:22.383959    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:22.964160 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:22.964123    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:23.357197 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:23.357160    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:23.564344 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:23.564310    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:24.032405 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:24.032373    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:24.159959 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:24.159929    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:24.762976 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:24.762947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:24.960582 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:24.960552    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:25.048047 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:25.047953    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" podUID="6407076e-3cc8-474c-9e1c-96a4110d78f5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 03 23:34:25.060715 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:25.060686    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:25.195915 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:25.195884    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:25.357087 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:25.357007    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:25.564365 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:25.564328    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:25.757992 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:25.757958    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:26.161342 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:26.161226    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:27.335238 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:27.335199    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:27.335654 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:27.335249    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:27.335726 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:27.335709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32142187-de54-4fef-82eb-c7b8c9296ff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:27.337603 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:27.337585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32142187-de54-4fef-82eb-c7b8c9296ff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmqr7\" (UID: \"32142187-de54-4fef-82eb-c7b8c9296ff3\") " pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:27.633602 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:27.633520    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmqr7"
Aug 03 23:34:27.756370 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:27.756331    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmqr7"]
Aug 03 23:34:27.760402 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:34:27.760376    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32142187_de54_4fef_82eb_c7b8c9296ff3.slice/crio-b97c3d9f1fe6b6919eca8a8436b461752456194b1db226eca75f0dca02809a6b WatchSource:0}: Error finding container b97c3d9f1fe6b6919eca8a8436b461752456194b1db226eca75f0dca02809a6b: Status 404 returned error can't find the container with id b97c3d9f1fe6b6919eca8a8436b461752456194b1db226eca75f0dca02809a6b
Aug 03 23:34:28.508102 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:28.508055    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmqr7" event={"ID":"32142187-de54-4fef-82eb-c7b8c9296ff3","Type":"ContainerStarted","Data":"76a4a98f190db5a23be4dc5577da3da5357f9291044b5d6cc834054a03ddcdcf"}
Aug 03 23:34:28.508500 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:28.508141    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmqr7" event={"ID":"32142187-de54-4fef-82eb-c7b8c9296ff3","Type":"ContainerStarted","Data":"93282d691966e169ebd2b4859b0adbdd7252973ba091295f15f06bdd96a26b1c"}
Aug 03 23:34:28.508500 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:28.508169    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmqr7" event={"ID":"32142187-de54-4fef-82eb-c7b8c9296ff3","Type":"ContainerStarted","Data":"b97c3d9f1fe6b6919eca8a8436b461752456194b1db226eca75f0dca02809a6b"}
Aug 03 23:34:30.517054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:30.517010    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmqr7" event={"ID":"32142187-de54-4fef-82eb-c7b8c9296ff3","Type":"ContainerStarted","Data":"17d900f83cbf2c705f9118c14e83093c4c1a271d96baac1b93bf43856bf28d11"}
Aug 03 23:34:30.537877 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:30.537827    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cmqr7" podStartSLOduration=17.629846609 podStartE2EDuration="19.537812161s" totalImagesPullingTime="1.907965552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-03 23:34:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:34:30.536798769 +0000 UTC m=+271.423127234" watchObservedRunningTime="2026-08-03 23:34:30.537812161 +0000 UTC m=+271.424140625"
Aug 03 23:34:30.683942 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:30.683898    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:30.786725 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:30.786632    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:30.840770 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:30.840740    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:30.976608 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:30.976577    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:31.165679 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:31.165606    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:31.357881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:31.357850    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:31.413523 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:31.413495    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:32.568910 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:32.568876    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:32.766940 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:32.766909    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:32.818623 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:32.818596    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:33.369291 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:33.369248    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:35.047779 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.047735    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" podUID="6407076e-3cc8-474c-9e1c-96a4110d78f5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 03 23:34:35.479090 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.479062    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:35.531922 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.531895    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:35.980551 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.980523    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"]
Aug 03 23:34:35.982812 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.982796    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:35.985619 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.985593    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m6v2t\""
Aug 03 23:34:35.985619 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.985593    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 03 23:34:35.985820 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.985620    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 03 23:34:35.985820 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.985730    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 03 23:34:35.990427 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.990408    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 03 23:34:35.996536 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:35.996515    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"]
Aug 03 23:34:36.002885 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.002859    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:36.101496 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.101453    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/560bae50-effb-4184-aefe-4af46da04b42-installation-pull-secrets\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.101913 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.101503    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/560bae50-effb-4184-aefe-4af46da04b42-registry-tls\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.101913 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.101577    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/560bae50-effb-4184-aefe-4af46da04b42-ca-trust-extracted\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.101913 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.101603    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/560bae50-effb-4184-aefe-4af46da04b42-trusted-ca\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.101913 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.101622    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/560bae50-effb-4184-aefe-4af46da04b42-registry-certificates\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.101913 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.101699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/560bae50-effb-4184-aefe-4af46da04b42-bound-sa-token\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.101913 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.101745    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/560bae50-effb-4184-aefe-4af46da04b42-image-registry-private-configuration\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.101913 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.101777    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bmjs\" (UniqueName: \"kubernetes.io/projected/560bae50-effb-4184-aefe-4af46da04b42-kube-api-access-9bmjs\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.202475 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.202435    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/560bae50-effb-4184-aefe-4af46da04b42-ca-trust-extracted\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.202475 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.202471    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/560bae50-effb-4184-aefe-4af46da04b42-trusted-ca\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.202724 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.202490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/560bae50-effb-4184-aefe-4af46da04b42-registry-certificates\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.202724 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.202661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/560bae50-effb-4184-aefe-4af46da04b42-bound-sa-token\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.202826 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.202724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/560bae50-effb-4184-aefe-4af46da04b42-image-registry-private-configuration\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.202826 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.202763    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bmjs\" (UniqueName: \"kubernetes.io/projected/560bae50-effb-4184-aefe-4af46da04b42-kube-api-access-9bmjs\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.202826 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.202796    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/560bae50-effb-4184-aefe-4af46da04b42-installation-pull-secrets\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.202964 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.202842    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/560bae50-effb-4184-aefe-4af46da04b42-ca-trust-extracted\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.203005 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.202977    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/560bae50-effb-4184-aefe-4af46da04b42-registry-tls\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.203340 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.203313    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/560bae50-effb-4184-aefe-4af46da04b42-registry-certificates\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.203453 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.203395    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/560bae50-effb-4184-aefe-4af46da04b42-trusted-ca\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.205539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.205518    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/560bae50-effb-4184-aefe-4af46da04b42-registry-tls\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.205754 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.205739    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/560bae50-effb-4184-aefe-4af46da04b42-installation-pull-secrets\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.205884 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.205865    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/560bae50-effb-4184-aefe-4af46da04b42-image-registry-private-configuration\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.213485 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.213459    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/560bae50-effb-4184-aefe-4af46da04b42-bound-sa-token\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.213616 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.213597    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bmjs\" (UniqueName: \"kubernetes.io/projected/560bae50-effb-4184-aefe-4af46da04b42-kube-api-access-9bmjs\") pod \"image-registry-7fc98d7d5d-fbdgg\" (UID: \"560bae50-effb-4184-aefe-4af46da04b42\") " pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.291833 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.291730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.421453 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.421420    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"]
Aug 03 23:34:36.424401 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:34:36.424374    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560bae50_effb_4184_aefe_4af46da04b42.slice/crio-537f42bdac1b2fc4a5d8e9d05f201af6daa2647065ae1819f4b5611999e73e9f WatchSource:0}: Error finding container 537f42bdac1b2fc4a5d8e9d05f201af6daa2647065ae1819f4b5611999e73e9f: Status 404 returned error can't find the container with id 537f42bdac1b2fc4a5d8e9d05f201af6daa2647065ae1819f4b5611999e73e9f
Aug 03 23:34:36.537222 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.537186    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg" event={"ID":"560bae50-effb-4184-aefe-4af46da04b42","Type":"ContainerStarted","Data":"03e29a7ddebec9623813abf9570ec1af00cc1e04e15524f67848ea1e04f90ee2"}
Aug 03 23:34:36.537412 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.537240    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg" event={"ID":"560bae50-effb-4184-aefe-4af46da04b42","Type":"ContainerStarted","Data":"537f42bdac1b2fc4a5d8e9d05f201af6daa2647065ae1819f4b5611999e73e9f"}
Aug 03 23:34:36.537412 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.537296    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:36.554545 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:36.554345    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg" podStartSLOduration=1.554326849 podStartE2EDuration="1.554326849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:34:36.553986944 +0000 UTC m=+277.440315409" watchObservedRunningTime="2026-08-03 23:34:36.554326849 +0000 UTC m=+277.440655314"
Aug 03 23:34:37.301043 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:37.301008    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:39.231218 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:39.231183    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:39.299248 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:39.299213    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:39.565245 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:39.565149    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:39.782999 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:39.782964    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:39.837675 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:39.837585    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:41.196282 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:41.196223    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nlkm9" podUID="9b80e13a-d7dd-4513-8219-c98d1017b80e"
Aug 03 23:34:41.551251 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:41.551224    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:34:42.053003 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:42.052967    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:42.381062 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:42.380971    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:44.376206 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.376153    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:44.461811 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.461770    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:34:44.464300 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.464246    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b80e13a-d7dd-4513-8219-c98d1017b80e-metrics-tls\") pod \"dns-default-nlkm9\" (UID: \"9b80e13a-d7dd-4513-8219-c98d1017b80e\") " pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:34:44.553917 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.553884    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rmmw5\""
Aug 03 23:34:44.562456 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.562422    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:34:44.575364 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.575333    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:44.655459 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.655236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:44.655459 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.655306    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rj2h5"]
Aug 03 23:34:44.659750 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.659716    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.661668 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.661616    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 03 23:34:44.661862 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.661843    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 03 23:34:44.662082 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.662069    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 03 23:34:44.662680 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.662660    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 03 23:34:44.662980 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.662963    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 03 23:34:44.663462 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.663361    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 03 23:34:44.664352 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.663872    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zn6kg\""
Aug 03 23:34:44.696211 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.696180    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nlkm9"]
Aug 03 23:34:44.699379 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:34:44.699355    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b80e13a_d7dd_4513_8219_c98d1017b80e.slice/crio-ada6f39edea59c0e5c1e7274fe64bf9f7ed9fe32c4320296fa9b397170507298 WatchSource:0}: Error finding container ada6f39edea59c0e5c1e7274fe64bf9f7ed9fe32c4320296fa9b397170507298: Status 404 returned error can't find the container with id ada6f39edea59c0e5c1e7274fe64bf9f7ed9fe32c4320296fa9b397170507298
Aug 03 23:34:44.763174 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.763139    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-tls\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.763357 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.763191    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3e6fbf5-951b-459c-9db6-15a7e70014f6-sys\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.763357 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.763219    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.763357 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.763314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-textfile\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.763357 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.763344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e6fbf5-951b-459c-9db6-15a7e70014f6-metrics-client-ca\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.763509 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.763373    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3e6fbf5-951b-459c-9db6-15a7e70014f6-root\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.763509 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.763391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.763509 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.763409    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-wtmp\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.763509 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.763451    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9psk\" (UniqueName: \"kubernetes.io/projected/e3e6fbf5-951b-459c-9db6-15a7e70014f6-kube-api-access-b9psk\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864338 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3e6fbf5-951b-459c-9db6-15a7e70014f6-root\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864338 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864589 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864361    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-wtmp\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864589 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9psk\" (UniqueName: \"kubernetes.io/projected/e3e6fbf5-951b-459c-9db6-15a7e70014f6-kube-api-access-b9psk\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864589 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864424    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-tls\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864589 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864443    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3e6fbf5-951b-459c-9db6-15a7e70014f6-root\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864589 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864467    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3e6fbf5-951b-459c-9db6-15a7e70014f6-sys\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864589 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864515    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3e6fbf5-951b-459c-9db6-15a7e70014f6-sys\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864589 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864589 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864530    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-wtmp\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864589 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864565    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-textfile\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.864589 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.864592    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e6fbf5-951b-459c-9db6-15a7e70014f6-metrics-client-ca\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.865015 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:44.864609    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 03 23:34:44.865015 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:44.864671    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-tls podName:e3e6fbf5-951b-459c-9db6-15a7e70014f6 nodeName:}" failed. No retries permitted until 2026-08-03 23:34:45.364650472 +0000 UTC m=+286.250978938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-tls") pod "node-exporter-rj2h5" (UID: "e3e6fbf5-951b-459c-9db6-15a7e70014f6") : secret "node-exporter-tls" not found
Aug 03 23:34:44.865132 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.865110    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-textfile\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.865196 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.865172    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.865196 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.865187    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e6fbf5-951b-459c-9db6-15a7e70014f6-metrics-client-ca\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.866997 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.866976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.875526 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.875498    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9psk\" (UniqueName: \"kubernetes.io/projected/e3e6fbf5-951b-459c-9db6-15a7e70014f6-kube-api-access-b9psk\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:44.885163 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.885133    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:44.996403 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:44.996371    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:45.048306 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.048249    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" podUID="6407076e-3cc8-474c-9e1c-96a4110d78f5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 03 23:34:45.048458 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.048347    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6"
Aug 03 23:34:45.048863 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.048831    2568 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"ea35f3ba59fafdf4a0b337d9e739b69d6523126f4210dfc47e40fdd36c181982"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Aug 03 23:34:45.048918 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.048884    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" podUID="6407076e-3cc8-474c-9e1c-96a4110d78f5" containerName="service-proxy" containerID="cri-o://ea35f3ba59fafdf4a0b337d9e739b69d6523126f4210dfc47e40fdd36c181982" gracePeriod=30
Aug 03 23:34:45.097124 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.097092    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:45.197569 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.197530    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:45.298751 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.298658    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:45.368796 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.368762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-tls\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:45.371487 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.371458    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3e6fbf5-951b-459c-9db6-15a7e70014f6-node-exporter-tls\") pod \"node-exporter-rj2h5\" (UID: \"e3e6fbf5-951b-459c-9db6-15a7e70014f6\") " pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:45.565976 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.565888    2568 generic.go:356] "Generic (PLEG): container finished" podID="6407076e-3cc8-474c-9e1c-96a4110d78f5" containerID="ea35f3ba59fafdf4a0b337d9e739b69d6523126f4210dfc47e40fdd36c181982" exitCode=2
Aug 03 23:34:45.565976 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.565956    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" event={"ID":"6407076e-3cc8-474c-9e1c-96a4110d78f5","Type":"ContainerDied","Data":"ea35f3ba59fafdf4a0b337d9e739b69d6523126f4210dfc47e40fdd36c181982"}
Aug 03 23:34:45.566450 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.566009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-847fddc84c-vvdj6" event={"ID":"6407076e-3cc8-474c-9e1c-96a4110d78f5","Type":"ContainerStarted","Data":"a07cccd3582fa93a088bbebc1849ec3998604ac1f071609e31c1f42fad250dcf"}
Aug 03 23:34:45.567744 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.567705    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nlkm9" event={"ID":"9b80e13a-d7dd-4513-8219-c98d1017b80e","Type":"ContainerStarted","Data":"ada6f39edea59c0e5c1e7274fe64bf9f7ed9fe32c4320296fa9b397170507298"}
Aug 03 23:34:45.574004 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.573976    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rj2h5"
Aug 03 23:34:45.585250 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:34:45.585222    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e6fbf5_951b_459c_9db6_15a7e70014f6.slice/crio-9712f1e5819687212b4702edad74191c0f7cfc6e05a26fd019f45e9f8dcec8ea WatchSource:0}: Error finding container 9712f1e5819687212b4702edad74191c0f7cfc6e05a26fd019f45e9f8dcec8ea: Status 404 returned error can't find the container with id 9712f1e5819687212b4702edad74191c0f7cfc6e05a26fd019f45e9f8dcec8ea
Aug 03 23:34:45.612836 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.612801    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:45.690024 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.689990    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:45.919603 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:45.919530    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:46.012444 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:46.012413    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:46.187460 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:46.187383    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:46.572894 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:46.572859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nlkm9" event={"ID":"9b80e13a-d7dd-4513-8219-c98d1017b80e","Type":"ContainerStarted","Data":"160ef4b020cea6f608f72ee628439734681ffc92a9c0618fa10491606fb87386"}
Aug 03 23:34:46.573380 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:46.572918    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nlkm9" event={"ID":"9b80e13a-d7dd-4513-8219-c98d1017b80e","Type":"ContainerStarted","Data":"b4192a04db46873ba084c9fe1899d1d39d7c6667e98150c52dc3b2e373f72039"}
Aug 03 23:34:46.573380 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:46.572997    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:34:46.574321 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:46.574296    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rj2h5" event={"ID":"e3e6fbf5-951b-459c-9db6-15a7e70014f6","Type":"ContainerStarted","Data":"9712f1e5819687212b4702edad74191c0f7cfc6e05a26fd019f45e9f8dcec8ea"}
Aug 03 23:34:46.588822 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:46.588738    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nlkm9" podStartSLOduration=251.096095462 podStartE2EDuration="4m12.588717033s" totalImagesPullingTime="1.492621571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:30:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:34:46.587648086 +0000 UTC m=+287.473976551" watchObservedRunningTime="2026-08-03 23:34:46.588717033 +0000 UTC m=+287.475045499"
Aug 03 23:34:47.567900 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:47.567861    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:47.579346 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:47.579311    2568 generic.go:356] "Generic (PLEG): container finished" podID="e3e6fbf5-951b-459c-9db6-15a7e70014f6" containerID="58e9216b004d01dc43b4e669beab22377de79d6a9ea149a7347a7c5a02e8a3b7" exitCode=0
Aug 03 23:34:47.579730 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:47.579411    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rj2h5" event={"ID":"e3e6fbf5-951b-459c-9db6-15a7e70014f6","Type":"ContainerDied","Data":"58e9216b004d01dc43b4e669beab22377de79d6a9ea149a7347a7c5a02e8a3b7"}
Aug 03 23:34:47.668294 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:47.668254    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:47.815296 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:47.815248    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:47.913445 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:47.913347    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:48.013772 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.013732    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:48.584302 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.584249    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rj2h5" event={"ID":"e3e6fbf5-951b-459c-9db6-15a7e70014f6","Type":"ContainerStarted","Data":"3e7f30da7e6233ae430764a8cf68ed78fb4e1a44d55f59954fbf7d2081e8c3c1"}
Aug 03 23:34:48.584660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.584349    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rj2h5" event={"ID":"e3e6fbf5-951b-459c-9db6-15a7e70014f6","Type":"ContainerStarted","Data":"61d2561a5e2b8565d2ab51bc0ea8e5edd4b68712922c639ec2fd7f0780df12af"}
Aug 03 23:34:48.604490 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.604442    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rj2h5" podStartSLOduration=3.427748416 podStartE2EDuration="4.604427364s" totalImagesPullingTime="1.102184408s" totalInitContainerRuntime="74.49454ms" isStatefulPod=true podCreationTimestamp="2026-08-03 23:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:34:48.60290667 +0000 UTC m=+289.489235146" watchObservedRunningTime="2026-08-03 23:34:48.604427364 +0000 UTC m=+289.490755828"
Aug 03 23:34:48.919062 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.918988    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"]
Aug 03 23:34:48.920996 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.920980    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:48.923381 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.923356    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6tpgl\""
Aug 03 23:34:48.923522 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.923413    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 03 23:34:48.923522 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.923465    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 03 23:34:48.924119 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.924100    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 03 23:34:48.924253 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.924239    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 03 23:34:48.924465 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.924447    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cpga01aeomjtm\""
Aug 03 23:34:48.932751 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:48.932725    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"]
Aug 03 23:34:49.000169 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.000135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzz2c\" (UniqueName: \"kubernetes.io/projected/d811728b-f579-4d8b-be5e-b3b59dbf7b67-kube-api-access-qzz2c\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.000169 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.000172    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d811728b-f579-4d8b-be5e-b3b59dbf7b67-secret-metrics-server-tls\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.000441 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.000198    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d811728b-f579-4d8b-be5e-b3b59dbf7b67-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.000441 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.000340    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d811728b-f579-4d8b-be5e-b3b59dbf7b67-audit-log\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.000441 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.000381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d811728b-f579-4d8b-be5e-b3b59dbf7b67-client-ca-bundle\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.000579 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.000450    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d811728b-f579-4d8b-be5e-b3b59dbf7b67-secret-metrics-server-client-certs\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.000579 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.000479    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d811728b-f579-4d8b-be5e-b3b59dbf7b67-metrics-server-audit-profiles\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.101543 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.101487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d811728b-f579-4d8b-be5e-b3b59dbf7b67-audit-log\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.101543 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.101546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d811728b-f579-4d8b-be5e-b3b59dbf7b67-client-ca-bundle\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.101728 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.101574    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d811728b-f579-4d8b-be5e-b3b59dbf7b67-secret-metrics-server-client-certs\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.101728 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.101628    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d811728b-f579-4d8b-be5e-b3b59dbf7b67-metrics-server-audit-profiles\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.101728 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.101680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzz2c\" (UniqueName: \"kubernetes.io/projected/d811728b-f579-4d8b-be5e-b3b59dbf7b67-kube-api-access-qzz2c\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.101728 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.101711    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d811728b-f579-4d8b-be5e-b3b59dbf7b67-secret-metrics-server-tls\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.101932 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.101736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d811728b-f579-4d8b-be5e-b3b59dbf7b67-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.101932 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.101922    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d811728b-f579-4d8b-be5e-b3b59dbf7b67-audit-log\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.102527 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.102415    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d811728b-f579-4d8b-be5e-b3b59dbf7b67-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.102899 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.102876    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d811728b-f579-4d8b-be5e-b3b59dbf7b67-metrics-server-audit-profiles\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.104124 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.104094    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d811728b-f579-4d8b-be5e-b3b59dbf7b67-secret-metrics-server-client-certs\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.104217 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.104176    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d811728b-f579-4d8b-be5e-b3b59dbf7b67-client-ca-bundle\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.104286 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.104230    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d811728b-f579-4d8b-be5e-b3b59dbf7b67-secret-metrics-server-tls\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.109192 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.109168    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzz2c\" (UniqueName: \"kubernetes.io/projected/d811728b-f579-4d8b-be5e-b3b59dbf7b67-kube-api-access-qzz2c\") pod \"metrics-server-6dc4744f4f-vf6fd\" (UID: \"d811728b-f579-4d8b-be5e-b3b59dbf7b67\") " pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.230414 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.230379    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:34:49.356598 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.356512    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"]
Aug 03 23:34:49.361000 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:34:49.360970    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd811728b_f579_4d8b_be5e_b3b59dbf7b67.slice/crio-22cd4d91957400ddff619bdc4e730ccc7f987b61118b7b14bba088fcc40d33f7 WatchSource:0}: Error finding container 22cd4d91957400ddff619bdc4e730ccc7f987b61118b7b14bba088fcc40d33f7: Status 404 returned error can't find the container with id 22cd4d91957400ddff619bdc4e730ccc7f987b61118b7b14bba088fcc40d33f7
Aug 03 23:34:49.388129 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.388104    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:49.447049 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.447019    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:49.578242 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.578160    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:49.589220 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:49.589190    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd" event={"ID":"d811728b-f579-4d8b-be5e-b3b59dbf7b67","Type":"ContainerStarted","Data":"22cd4d91957400ddff619bdc4e730ccc7f987b61118b7b14bba088fcc40d33f7"}
Aug 03 23:34:50.839414 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:50.839381    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:51.078148 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:51.078117    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:51.597736 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:51.597697    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd" event={"ID":"d811728b-f579-4d8b-be5e-b3b59dbf7b67","Type":"ContainerStarted","Data":"99ec2750c234874c5df26e8283f7ca3d261dbe4c8b08deb3a5447a059005cf6d"}
Aug 03 23:34:51.617598 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:51.617535    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd" podStartSLOduration=2.287900274 podStartE2EDuration="3.617516063s" totalImagesPullingTime="1.329615789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:34:51.61581549 +0000 UTC m=+292.502143952" watchObservedRunningTime="2026-08-03 23:34:51.617516063 +0000 UTC m=+292.503844529"
Aug 03 23:34:52.655177 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:34:52.655136    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bd4gd" podUID="1ed5d7d8-00c5-464f-a9ca-ba56adfd186e"
Aug 03 23:34:53.412100 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:53.412064    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:53.511295 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:53.511253    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:53.612279 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:53.612227    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:54.122827 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:54.122797    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:54.224945 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:54.224908    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:55.398229 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:55.398195    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:55.498212 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:55.498181    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:56.582539 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:56.582511    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nlkm9"
Aug 03 23:34:56.900135 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:56.900050    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:56.955752 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:56.955715    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:57.545327 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:57.545300    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fc98d7d5d-fbdgg"
Aug 03 23:34:57.596702 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:57.596672    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:57.694653 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:57.694624    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:57.795307 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:57.795218    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:57.848973 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:57.848893    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:34:59.506639 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:34:59.506614    2568 kubelet.go:1648] "Image garbage collection succeeded"
Aug 03 23:35:02.412342 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:02.412300    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:02.484678 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:02.484631    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:04.653795 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:04.653758    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:35:06.389026 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:06.388988    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:06.440740 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:06.440707    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:07.588431 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:07.588381    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:09.231196 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:09.231155    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:35:09.231634 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:09.231277    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:35:09.786123 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:09.786084    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:09.887669 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:09.887638    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:11.425106 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:11.425067    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:11.527437 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:11.527403    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:20.473685 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:20.473639    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:20.531212 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:20.531184    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:35:29.236470 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:29.236438    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:35:29.240209 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:35:29.240185    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6dc4744f4f-vf6fd"
Aug 03 23:36:02.783097 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:02.783067    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:02.853147 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:02.853113    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:03.801011 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:03.800977    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:04.082352 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:04.082253    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:08.146780 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:08.146752    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:08.247219 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:08.247191    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:12.229748 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:12.229705    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:12.330949 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:12.330918    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:12.431341 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:12.431306    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:12.590487 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:12.590406    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:12.691234 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:12.691204    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:13.477506 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:13.477475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:36:13.479963 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:13.479940    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed5d7d8-00c5-464f-a9ca-ba56adfd186e-metrics-certs\") pod \"network-metrics-daemon-bd4gd\" (UID: \"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e\") " pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:36:13.657438 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:13.657415    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6szp\""
Aug 03 23:36:13.665129 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:13.665111    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd4gd"
Aug 03 23:36:13.797198 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:13.797161    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bd4gd"]
Aug 03 23:36:13.800130 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:36:13.800088    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed5d7d8_00c5_464f_a9ca_ba56adfd186e.slice/crio-c4d51bb273bc8eae321ef7b7d8fc1fb1225d26ebe3a55e435f8b79eefc939866 WatchSource:0}: Error finding container c4d51bb273bc8eae321ef7b7d8fc1fb1225d26ebe3a55e435f8b79eefc939866: Status 404 returned error can't find the container with id c4d51bb273bc8eae321ef7b7d8fc1fb1225d26ebe3a55e435f8b79eefc939866
Aug 03 23:36:13.802066 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:13.802051    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 03 23:36:13.865088 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:13.865055    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bd4gd" event={"ID":"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e","Type":"ContainerStarted","Data":"c4d51bb273bc8eae321ef7b7d8fc1fb1225d26ebe3a55e435f8b79eefc939866"}
Aug 03 23:36:14.780590 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:14.780558    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:14.869846 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:14.869810    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bd4gd" event={"ID":"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e","Type":"ContainerStarted","Data":"63e192e9692c5f099c524900c940ea59445d152f8ea1d24a9548123a24e75b3d"}
Aug 03 23:36:14.870009 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:14.869876    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bd4gd" event={"ID":"1ed5d7d8-00c5-464f-a9ca-ba56adfd186e","Type":"ContainerStarted","Data":"198770934adf94836cdd9b8504adc33cb3b55cc7250e239be2117591b6beae75"}
Aug 03 23:36:14.884996 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:14.884908    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bd4gd" podStartSLOduration=375.052716429 podStartE2EDuration="6m15.884890572s" totalImagesPullingTime="832.174143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:36:14.883953742 +0000 UTC m=+375.770282207" watchObservedRunningTime="2026-08-03 23:36:14.884890572 +0000 UTC m=+375.771219039"
Aug 03 23:36:14.971787 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:14.971752    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:15.028462 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:15.028413    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:22.903805 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:22.903770    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:22.954868 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:22.954840    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:36:23.009611 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:36:23.009578    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:11.893403 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:11.893370    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:19.019988 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:19.019948    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:19.071923 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:19.071882    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:22.548927 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:22.548550    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:22.603932 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:22.603889    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:22.732350 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:22.732320    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:22.838892 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:22.838810    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:23.297109 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:23.297069    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:23.352794 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:23.352767    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:30.974235 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:30.974193    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:31.077222 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:31.077195    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:33.184093 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:33.184053    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:33.284909 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:33.284879    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:33.347824 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:33.347794    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:35.483911 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:35.483880    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:37:35.581092 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:37:35.581063    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:15.614766 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:15.614722    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:15.716019 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:15.715985    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:24.547826 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:24.547754    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:24.648867 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:24.648831    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:49.273048 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:49.273013    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:50.830739 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:50.830700    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:52.688866 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:52.688830    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:52.791878 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:52.791848    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:53.747729 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:53.747701    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:53.844828 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:53.844795    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:54.701867 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:54.701827    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:54.801791 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:54.801760    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:56.704927 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:56.704889    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:57.108603 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:57.108574    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:59.888206 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:59.888168    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:38:59.941823 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:38:59.941794    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:05.357250 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:05.357216    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:05.930428 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:05.930398    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:06.022034 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.021998    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:06.062881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.062847    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k8pq9"]
Aug 03 23:39:06.065876 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.065859    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k8pq9"
Aug 03 23:39:06.068079 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.068059    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 03 23:39:06.068171 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.068107    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rp9zl\""
Aug 03 23:39:06.068923 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.068910    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 03 23:39:06.071397 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.071369    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k8pq9"]
Aug 03 23:39:06.140922 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.140877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htg2g\" (UniqueName: \"kubernetes.io/projected/7b0cfb39-b69e-46f3-8ebd-5385f56ef539-kube-api-access-htg2g\") pod \"cert-manager-55b4d954d5-k8pq9\" (UID: \"7b0cfb39-b69e-46f3-8ebd-5385f56ef539\") " pod="cert-manager/cert-manager-55b4d954d5-k8pq9"
Aug 03 23:39:06.141095 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.140940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b0cfb39-b69e-46f3-8ebd-5385f56ef539-bound-sa-token\") pod \"cert-manager-55b4d954d5-k8pq9\" (UID: \"7b0cfb39-b69e-46f3-8ebd-5385f56ef539\") " pod="cert-manager/cert-manager-55b4d954d5-k8pq9"
Aug 03 23:39:06.242126 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.242098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b0cfb39-b69e-46f3-8ebd-5385f56ef539-bound-sa-token\") pod \"cert-manager-55b4d954d5-k8pq9\" (UID: \"7b0cfb39-b69e-46f3-8ebd-5385f56ef539\") " pod="cert-manager/cert-manager-55b4d954d5-k8pq9"
Aug 03 23:39:06.242307 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.242143    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htg2g\" (UniqueName: \"kubernetes.io/projected/7b0cfb39-b69e-46f3-8ebd-5385f56ef539-kube-api-access-htg2g\") pod \"cert-manager-55b4d954d5-k8pq9\" (UID: \"7b0cfb39-b69e-46f3-8ebd-5385f56ef539\") " pod="cert-manager/cert-manager-55b4d954d5-k8pq9"
Aug 03 23:39:06.250294 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.250245    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b0cfb39-b69e-46f3-8ebd-5385f56ef539-bound-sa-token\") pod \"cert-manager-55b4d954d5-k8pq9\" (UID: \"7b0cfb39-b69e-46f3-8ebd-5385f56ef539\") " pod="cert-manager/cert-manager-55b4d954d5-k8pq9"
Aug 03 23:39:06.250567 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.250545    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htg2g\" (UniqueName: \"kubernetes.io/projected/7b0cfb39-b69e-46f3-8ebd-5385f56ef539-kube-api-access-htg2g\") pod \"cert-manager-55b4d954d5-k8pq9\" (UID: \"7b0cfb39-b69e-46f3-8ebd-5385f56ef539\") " pod="cert-manager/cert-manager-55b4d954d5-k8pq9"
Aug 03 23:39:06.375943 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.375895    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k8pq9"
Aug 03 23:39:06.508341 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:06.508250    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k8pq9"]
Aug 03 23:39:06.511358 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:39:06.511320    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b0cfb39_b69e_46f3_8ebd_5385f56ef539.slice/crio-904e348c9793a7f9057d4c3e73ca6f8e3b40052771d07cf0af8f8a844b4c9e23 WatchSource:0}: Error finding container 904e348c9793a7f9057d4c3e73ca6f8e3b40052771d07cf0af8f8a844b4c9e23: Status 404 returned error can't find the container with id 904e348c9793a7f9057d4c3e73ca6f8e3b40052771d07cf0af8f8a844b4c9e23
Aug 03 23:39:07.443407 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:07.443364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k8pq9" event={"ID":"7b0cfb39-b69e-46f3-8ebd-5385f56ef539","Type":"ContainerStarted","Data":"904e348c9793a7f9057d4c3e73ca6f8e3b40052771d07cf0af8f8a844b4c9e23"}
Aug 03 23:39:08.124939 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.124899    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"]
Aug 03 23:39:08.133619 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.133575    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"
Aug 03 23:39:08.134332 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.134254    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"]
Aug 03 23:39:08.136398 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.135917    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tdh52\""
Aug 03 23:39:08.136398 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.136189    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 03 23:39:08.137459 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.136911    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 03 23:39:08.258471 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.258416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6d9c9f0-5c86-4d83-870b-8c93b94b87e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zr7rb\" (UID: \"c6d9c9f0-5c86-4d83-870b-8c93b94b87e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"
Aug 03 23:39:08.258658 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.258550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8qqn\" (UniqueName: \"kubernetes.io/projected/c6d9c9f0-5c86-4d83-870b-8c93b94b87e4-kube-api-access-h8qqn\") pod \"openshift-lws-operator-fd8ccff4c-zr7rb\" (UID: \"c6d9c9f0-5c86-4d83-870b-8c93b94b87e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"
Aug 03 23:39:08.359563 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.359527    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6d9c9f0-5c86-4d83-870b-8c93b94b87e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zr7rb\" (UID: \"c6d9c9f0-5c86-4d83-870b-8c93b94b87e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"
Aug 03 23:39:08.359743 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.359594    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8qqn\" (UniqueName: \"kubernetes.io/projected/c6d9c9f0-5c86-4d83-870b-8c93b94b87e4-kube-api-access-h8qqn\") pod \"openshift-lws-operator-fd8ccff4c-zr7rb\" (UID: \"c6d9c9f0-5c86-4d83-870b-8c93b94b87e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"
Aug 03 23:39:08.359974 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.359950    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6d9c9f0-5c86-4d83-870b-8c93b94b87e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zr7rb\" (UID: \"c6d9c9f0-5c86-4d83-870b-8c93b94b87e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"
Aug 03 23:39:08.368466 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.368436    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8qqn\" (UniqueName: \"kubernetes.io/projected/c6d9c9f0-5c86-4d83-870b-8c93b94b87e4-kube-api-access-h8qqn\") pod \"openshift-lws-operator-fd8ccff4c-zr7rb\" (UID: \"c6d9c9f0-5c86-4d83-870b-8c93b94b87e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"
Aug 03 23:39:08.446975 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:08.446899    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"
Aug 03 23:39:09.607529 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:09.607501    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb"]
Aug 03 23:39:09.611436 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:39:09.611407    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6d9c9f0_5c86_4d83_870b_8c93b94b87e4.slice/crio-d29dacaafb6786eec20b425dc3a25810b70ec851c49df5d4a10b41f7b8190973 WatchSource:0}: Error finding container d29dacaafb6786eec20b425dc3a25810b70ec851c49df5d4a10b41f7b8190973: Status 404 returned error can't find the container with id d29dacaafb6786eec20b425dc3a25810b70ec851c49df5d4a10b41f7b8190973
Aug 03 23:39:10.458236 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:10.458200    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k8pq9" event={"ID":"7b0cfb39-b69e-46f3-8ebd-5385f56ef539","Type":"ContainerStarted","Data":"b92906a6e2a8d08166760929e77f96face9ad5bcee61ad588994396eceeb550a"}
Aug 03 23:39:10.459807 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:10.459756    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb" event={"ID":"c6d9c9f0-5c86-4d83-870b-8c93b94b87e4","Type":"ContainerStarted","Data":"d29dacaafb6786eec20b425dc3a25810b70ec851c49df5d4a10b41f7b8190973"}
Aug 03 23:39:10.485138 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:10.485078    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-k8pq9" podStartSLOduration=1.452379748 podStartE2EDuration="4.485051876s" totalImagesPullingTime="3.032672128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:39:10.482849232 +0000 UTC m=+551.369177696" watchObservedRunningTime="2026-08-03 23:39:10.485051876 +0000 UTC m=+551.371380362"
Aug 03 23:39:12.468874 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:12.468840    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb" event={"ID":"c6d9c9f0-5c86-4d83-870b-8c93b94b87e4","Type":"ContainerStarted","Data":"fc466c869d2a454bb4403c42fa321546fc6b118a3f9bd35731e173a33a97e545"}
Aug 03 23:39:12.482521 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:12.482466    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zr7rb" podStartSLOduration=1.909406391 podStartE2EDuration="4.48245023s" totalImagesPullingTime="2.573043839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:39:12.481085247 +0000 UTC m=+553.367413712" watchObservedRunningTime="2026-08-03 23:39:12.48245023 +0000 UTC m=+553.368778695"
Aug 03 23:39:13.191370 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:13.191329    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:13.291578 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:13.291544    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:15.466980 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:15.466948    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:25.659429 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:25.659394    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:25.764297 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:25.764247    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:27.694222 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:27.694189    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:27.796413 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:27.796375    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:28.317933 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.317896    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:28.516485 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.516448    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:28.617874 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.617792    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:28.642949 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.642919    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"]
Aug 03 23:39:28.699838 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.699799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"]
Aug 03 23:39:28.700229 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.699928    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.702516 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.702499    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 03 23:39:28.702598 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.702506    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 03 23:39:28.702652 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.702636    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hcprk\""
Aug 03 23:39:28.702745 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.702661    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 03 23:39:28.702791 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.702745    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 03 23:39:28.804288 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.804237    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:28.821373 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.821351    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p5r7\" (UniqueName: \"kubernetes.io/projected/5392f3bc-4613-468d-848c-a0dadf73a3e6-kube-api-access-2p5r7\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.821459 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.821386    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5392f3bc-4613-468d-848c-a0dadf73a3e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.821459 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.821406    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5392f3bc-4613-468d-848c-a0dadf73a3e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.821535 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.821511    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5392f3bc-4613-468d-848c-a0dadf73a3e6-manifests\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.821577 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.821555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5392f3bc-4613-468d-848c-a0dadf73a3e6-tmp\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.904253 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.904177    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:28.922372 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.922347    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5392f3bc-4613-468d-848c-a0dadf73a3e6-manifests\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.922531 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.922396    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5392f3bc-4613-468d-848c-a0dadf73a3e6-tmp\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.922531 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.922420    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p5r7\" (UniqueName: \"kubernetes.io/projected/5392f3bc-4613-468d-848c-a0dadf73a3e6-kube-api-access-2p5r7\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.922531 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.922443    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5392f3bc-4613-468d-848c-a0dadf73a3e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.922531 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.922470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5392f3bc-4613-468d-848c-a0dadf73a3e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.922854 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.922831    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5392f3bc-4613-468d-848c-a0dadf73a3e6-manifests\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.924884 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.924866    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5392f3bc-4613-468d-848c-a0dadf73a3e6-tmp\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.925145 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.925128    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5392f3bc-4613-468d-848c-a0dadf73a3e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.925185 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.925137    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5392f3bc-4613-468d-848c-a0dadf73a3e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:28.930744 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:28.930716    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p5r7\" (UniqueName: \"kubernetes.io/projected/5392f3bc-4613-468d-848c-a0dadf73a3e6-kube-api-access-2p5r7\") pod \"opendatahub-operator-controller-manager-6869c6d9bb-5cbq2\" (UID: \"5392f3bc-4613-468d-848c-a0dadf73a3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:29.004994 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:29.004961    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:29.009744 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:29.009726    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:29.108752 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:29.108726    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:29.164233 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:29.164156    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"]
Aug 03 23:39:29.168458 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:39:29.168428    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5392f3bc_4613_468d_848c_a0dadf73a3e6.slice/crio-697bd318c65eba654c59d73aa4672a372ab62ce3323b0d38fa749a8bd567f984 WatchSource:0}: Error finding container 697bd318c65eba654c59d73aa4672a372ab62ce3323b0d38fa749a8bd567f984: Status 404 returned error can't find the container with id 697bd318c65eba654c59d73aa4672a372ab62ce3323b0d38fa749a8bd567f984
Aug 03 23:39:29.205002 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:29.204970    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:29.305045 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:29.305013    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:29.408660 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:29.408631    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:29.510691 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:29.510661    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:29.523830 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:29.523792    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2" event={"ID":"5392f3bc-4613-468d-848c-a0dadf73a3e6","Type":"ContainerStarted","Data":"697bd318c65eba654c59d73aa4672a372ab62ce3323b0d38fa749a8bd567f984"}
Aug 03 23:39:29.609987 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:29.609955    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:32.537186 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:32.537153    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2" event={"ID":"5392f3bc-4613-468d-848c-a0dadf73a3e6","Type":"ContainerStarted","Data":"54eebd7783d7ad9e6a7b6c86a67a2c91d409a6fa8878613191d743e5c5e074c8"}
Aug 03 23:39:33.546570 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:33.546532    2568 generic.go:356] "Generic (PLEG): container finished" podID="5392f3bc-4613-468d-848c-a0dadf73a3e6" containerID="54eebd7783d7ad9e6a7b6c86a67a2c91d409a6fa8878613191d743e5c5e074c8" exitCode=0
Aug 03 23:39:33.547024 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:33.546583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2" event={"ID":"5392f3bc-4613-468d-848c-a0dadf73a3e6","Type":"ContainerDied","Data":"54eebd7783d7ad9e6a7b6c86a67a2c91d409a6fa8878613191d743e5c5e074c8"}
Aug 03 23:39:34.552230 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:34.552187    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2" event={"ID":"5392f3bc-4613-468d-848c-a0dadf73a3e6","Type":"ContainerStarted","Data":"3388aae7935909ba2efbe37f18b84d1a604a648f82ce42213dc4121736a15b50"}
Aug 03 23:39:34.552625 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:34.552297    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:34.573742 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:34.573685    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2" podStartSLOduration=2.288834521 podStartE2EDuration="6.573665061s" totalImagesPullingTime="3.208448552s" totalInitContainerRuntime="1.076381988s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:39:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:39:34.572701339 +0000 UTC m=+575.459029803" watchObservedRunningTime="2026-08-03 23:39:34.573665061 +0000 UTC m=+575.459993528"
Aug 03 23:39:35.678764 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:35.678737    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:35.776005 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:35.775968    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:39.857499 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:39.857464    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:41.517923 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:41.517890    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:45.557556 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:45.557523    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6869c6d9bb-5cbq2"
Aug 03 23:39:45.880799 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:45.880712    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:45.981466 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:45.981436    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:46.081911 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:46.081882    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:46.684667 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:46.684633    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:46.741794 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:46.741756    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:47.385971 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:47.385929    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:47.491713 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:47.491681    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:48.116722 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.116680    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:48.220139 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.220110    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:48.281421 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.281388    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:48.511554 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.511522    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:48.581458 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.581418    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nhkdm"]
Aug 03 23:39:48.588202 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.588181    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:39:48.592181 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.592160    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6fxzq\""
Aug 03 23:39:48.592641 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.592622    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 03 23:39:48.605041 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.605009    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nhkdm"]
Aug 03 23:39:48.662878 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.662831    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ba5146-56fc-49c2-b642-f7c9e0b70b73-tls-certs\") pod \"model-serving-api-54d89bd5fc-nhkdm\" (UID: \"14ba5146-56fc-49c2-b642-f7c9e0b70b73\") " pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:39:48.663067 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.662946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rp2r\" (UniqueName: \"kubernetes.io/projected/14ba5146-56fc-49c2-b642-f7c9e0b70b73-kube-api-access-9rp2r\") pod \"model-serving-api-54d89bd5fc-nhkdm\" (UID: \"14ba5146-56fc-49c2-b642-f7c9e0b70b73\") " pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:39:48.764309 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.764176    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ba5146-56fc-49c2-b642-f7c9e0b70b73-tls-certs\") pod \"model-serving-api-54d89bd5fc-nhkdm\" (UID: \"14ba5146-56fc-49c2-b642-f7c9e0b70b73\") " pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:39:48.764309 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.764253    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rp2r\" (UniqueName: \"kubernetes.io/projected/14ba5146-56fc-49c2-b642-f7c9e0b70b73-kube-api-access-9rp2r\") pod \"model-serving-api-54d89bd5fc-nhkdm\" (UID: \"14ba5146-56fc-49c2-b642-f7c9e0b70b73\") " pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:39:48.764559 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:39:48.764370    2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Aug 03 23:39:48.764559 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:39:48.764468    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ba5146-56fc-49c2-b642-f7c9e0b70b73-tls-certs podName:14ba5146-56fc-49c2-b642-f7c9e0b70b73 nodeName:}" failed. No retries permitted until 2026-08-03 23:39:49.26444552 +0000 UTC m=+590.150773981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/14ba5146-56fc-49c2-b642-f7c9e0b70b73-tls-certs") pod "model-serving-api-54d89bd5fc-nhkdm" (UID: "14ba5146-56fc-49c2-b642-f7c9e0b70b73") : secret "model-serving-api-tls" not found
Aug 03 23:39:48.773162 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.773132    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rp2r\" (UniqueName: \"kubernetes.io/projected/14ba5146-56fc-49c2-b642-f7c9e0b70b73-kube-api-access-9rp2r\") pod \"model-serving-api-54d89bd5fc-nhkdm\" (UID: \"14ba5146-56fc-49c2-b642-f7c9e0b70b73\") " pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:39:48.833230 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:48.833189    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:49.269551 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:49.269514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ba5146-56fc-49c2-b642-f7c9e0b70b73-tls-certs\") pod \"model-serving-api-54d89bd5fc-nhkdm\" (UID: \"14ba5146-56fc-49c2-b642-f7c9e0b70b73\") " pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:39:49.272010 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:49.271990    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ba5146-56fc-49c2-b642-f7c9e0b70b73-tls-certs\") pod \"model-serving-api-54d89bd5fc-nhkdm\" (UID: \"14ba5146-56fc-49c2-b642-f7c9e0b70b73\") " pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:39:49.498218 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:49.498168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:39:49.635134 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:49.634964    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nhkdm"]
Aug 03 23:39:49.638084 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:39:49.638053    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ba5146_56fc_49c2_b642_f7c9e0b70b73.slice/crio-c2dcaec2f1ad74fd85cd315067044e12506fecaefe97d94d182181a129305406 WatchSource:0}: Error finding container c2dcaec2f1ad74fd85cd315067044e12506fecaefe97d94d182181a129305406: Status 404 returned error can't find the container with id c2dcaec2f1ad74fd85cd315067044e12506fecaefe97d94d182181a129305406
Aug 03 23:39:50.616659 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:50.616543    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm" event={"ID":"14ba5146-56fc-49c2-b642-f7c9e0b70b73","Type":"ContainerStarted","Data":"c2dcaec2f1ad74fd85cd315067044e12506fecaefe97d94d182181a129305406"}
Aug 03 23:39:52.627213 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:52.627118    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm" event={"ID":"14ba5146-56fc-49c2-b642-f7c9e0b70b73","Type":"ContainerStarted","Data":"985959d4a29e5e9b8fc12e2cbe9bae3635bf54166508aae20d2b404e9cf54868"}
Aug 03 23:39:52.627640 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:52.627235    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:39:52.645057 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:52.644996    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm" podStartSLOduration=1.92195647 podStartE2EDuration="4.644977362s" totalImagesPullingTime="2.723020892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:39:52.641151053 +0000 UTC m=+593.527479509" watchObservedRunningTime="2026-08-03 23:39:52.644977362 +0000 UTC m=+593.531305826"
Aug 03 23:39:53.382974 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.382940    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:53.665875 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.665795    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"]
Aug 03 23:39:53.669012 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.668985    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:53.671489 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.671463    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 03 23:39:53.671647 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.671541    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 03 23:39:53.672462 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.672445    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 03 23:39:53.672607 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.672449    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 03 23:39:53.673053 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.673035    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dp2t8\""
Aug 03 23:39:53.678365 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.678336    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"]
Aug 03 23:39:53.707429 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.707381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23bc3e97-b882-4e74-866a-40c3f2bc9d51-tls-certs\") pod \"kube-auth-proxy-6bd58c6859-c8gpm\" (UID: \"23bc3e97-b882-4e74-866a-40c3f2bc9d51\") " pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:53.707665 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.707438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4gqq\" (UniqueName: \"kubernetes.io/projected/23bc3e97-b882-4e74-866a-40c3f2bc9d51-kube-api-access-k4gqq\") pod \"kube-auth-proxy-6bd58c6859-c8gpm\" (UID: \"23bc3e97-b882-4e74-866a-40c3f2bc9d51\") " pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:53.707665 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.707552    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23bc3e97-b882-4e74-866a-40c3f2bc9d51-tmp\") pod \"kube-auth-proxy-6bd58c6859-c8gpm\" (UID: \"23bc3e97-b882-4e74-866a-40c3f2bc9d51\") " pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:53.712185 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.712160    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:53.808943 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.808890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23bc3e97-b882-4e74-866a-40c3f2bc9d51-tls-certs\") pod \"kube-auth-proxy-6bd58c6859-c8gpm\" (UID: \"23bc3e97-b882-4e74-866a-40c3f2bc9d51\") " pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:53.808943 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.808937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gqq\" (UniqueName: \"kubernetes.io/projected/23bc3e97-b882-4e74-866a-40c3f2bc9d51-kube-api-access-k4gqq\") pod \"kube-auth-proxy-6bd58c6859-c8gpm\" (UID: \"23bc3e97-b882-4e74-866a-40c3f2bc9d51\") " pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:53.809290 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.808987    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23bc3e97-b882-4e74-866a-40c3f2bc9d51-tmp\") pod \"kube-auth-proxy-6bd58c6859-c8gpm\" (UID: \"23bc3e97-b882-4e74-866a-40c3f2bc9d51\") " pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:53.811448 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.811407    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23bc3e97-b882-4e74-866a-40c3f2bc9d51-tmp\") pod \"kube-auth-proxy-6bd58c6859-c8gpm\" (UID: \"23bc3e97-b882-4e74-866a-40c3f2bc9d51\") " pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:53.811640 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.811622    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23bc3e97-b882-4e74-866a-40c3f2bc9d51-tls-certs\") pod \"kube-auth-proxy-6bd58c6859-c8gpm\" (UID: \"23bc3e97-b882-4e74-866a-40c3f2bc9d51\") " pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:53.817496 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.817468    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4gqq\" (UniqueName: \"kubernetes.io/projected/23bc3e97-b882-4e74-866a-40c3f2bc9d51-kube-api-access-k4gqq\") pod \"kube-auth-proxy-6bd58c6859-c8gpm\" (UID: \"23bc3e97-b882-4e74-866a-40c3f2bc9d51\") " pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:53.981122 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:53.981089    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"
Aug 03 23:39:54.124792 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.124757    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm"]
Aug 03 23:39:54.133572 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:39:54.128426    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bc3e97_b882_4e74_866a_40c3f2bc9d51.slice/crio-1c8ad055cd20056e4910201523e11d8d79c78ae48856a0a535df37d652d2d25e WatchSource:0}: Error finding container 1c8ad055cd20056e4910201523e11d8d79c78ae48856a0a535df37d652d2d25e: Status 404 returned error can't find the container with id 1c8ad055cd20056e4910201523e11d8d79c78ae48856a0a535df37d652d2d25e
Aug 03 23:39:54.511511 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.511471    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"]
Aug 03 23:39:54.516516 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.516492    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.519884 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.519857    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 03 23:39:54.520459 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.520440    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 03 23:39:54.520625 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.520607    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 03 23:39:54.520873 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.520844    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2k6w9\""
Aug 03 23:39:54.520955 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.520942    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 03 23:39:54.535207 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.535173    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"]
Aug 03 23:39:54.538491 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.538460    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:54.616887 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.616847    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e54191-770d-4f8e-bafe-8c13dc0a5070-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.616887 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.616887    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.617138 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.616947    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.617138 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.616994    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.617138 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.617055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcfxn\" (UniqueName: \"kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-kube-api-access-qcfxn\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.617138 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.617090    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.617138 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.617121    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.635516 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.635483    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:54.638202 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.638171    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm" event={"ID":"23bc3e97-b882-4e74-866a-40c3f2bc9d51","Type":"ContainerStarted","Data":"1c8ad055cd20056e4910201523e11d8d79c78ae48856a0a535df37d652d2d25e"}
Aug 03 23:39:54.718016 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.717983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.718016 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.718016    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.718516 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.718038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcfxn\" (UniqueName: \"kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-kube-api-access-qcfxn\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.718516 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.718059    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.718516 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.718175    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.718516 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.718315    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e54191-770d-4f8e-bafe-8c13dc0a5070-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.718516 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.718350    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.718772 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.718574    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.720736 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.720713    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.720845 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.720798    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.720990 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.720967    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e54191-770d-4f8e-bafe-8c13dc0a5070-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.721085 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.721072    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.728080 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.728057    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.728438 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.728420    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcfxn\" (UniqueName: \"kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-kube-api-access-qcfxn\") pod \"istiod-openshift-gateway-7b7995d5cd-xh6l9\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.826361 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.826281    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:54.984383 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:54.984349    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"]
Aug 03 23:39:54.988605 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:39:54.988577    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e54191_770d_4f8e_bafe_8c13dc0a5070.slice/crio-5483b720abd6216fd764dd35e01507817857c7d67148810475c4f63ea7f46fa9 WatchSource:0}: Error finding container 5483b720abd6216fd764dd35e01507817857c7d67148810475c4f63ea7f46fa9: Status 404 returned error can't find the container with id 5483b720abd6216fd764dd35e01507817857c7d67148810475c4f63ea7f46fa9
Aug 03 23:39:55.644782 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:55.644748    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9" event={"ID":"d6e54191-770d-4f8e-bafe-8c13dc0a5070","Type":"ContainerStarted","Data":"5483b720abd6216fd764dd35e01507817857c7d67148810475c4f63ea7f46fa9"}
Aug 03 23:39:55.793073 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:55.793040    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:56.952897 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:56.952864    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:57.049761 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:57.049721    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:57.150030 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:57.149993    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:57.662612 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:57.662529    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm" event={"ID":"23bc3e97-b882-4e74-866a-40c3f2bc9d51","Type":"ContainerStarted","Data":"d77b5fc7e7a59545ae66db59f1e3fbda1ebb4fad2242f7336829f8ca47d20fed"}
Aug 03 23:39:57.687389 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:57.687321    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bd58c6859-c8gpm" podStartSLOduration=1.894489756 podStartE2EDuration="4.687293716s" totalImagesPullingTime="2.79280396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:39:57.686588205 +0000 UTC m=+598.572916677" watchObservedRunningTime="2026-08-03 23:39:57.687293716 +0000 UTC m=+598.573622188"
Aug 03 23:39:58.323192 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.323124    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:58.381929 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.381877    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"]
Aug 03 23:39:58.385039 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.385014    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"
Aug 03 23:39:58.387565 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.387539    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 03 23:39:58.387702 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.387578    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jfwnz\""
Aug 03 23:39:58.395604 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.395580    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"]
Aug 03 23:39:58.405339 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.403784    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:39:58.405339 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.404763    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"]
Aug 03 23:39:58.406912 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.406667    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 03 23:39:58.407646 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.407314    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kv4hw\""
Aug 03 23:39:58.413688 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.413655    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"]
Aug 03 23:39:58.416298 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.415989    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:58.452054 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.452018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e93b1aba-b926-4e19-992d-bdbd82583c17-cert\") pod \"kserve-controller-manager-d6f4b65b8-rtpmm\" (UID: \"e93b1aba-b926-4e19-992d-bdbd82583c17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"
Aug 03 23:39:58.452249 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.452091    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1da8cc91-c2c3-4c57-a474-8029cbd5a735-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7qfk5\" (UID: \"1da8cc91-c2c3-4c57-a474-8029cbd5a735\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:39:58.452249 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.452157    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24p7t\" (UniqueName: \"kubernetes.io/projected/e93b1aba-b926-4e19-992d-bdbd82583c17-kube-api-access-24p7t\") pod \"kserve-controller-manager-d6f4b65b8-rtpmm\" (UID: \"e93b1aba-b926-4e19-992d-bdbd82583c17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"
Aug 03 23:39:58.452375 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.452247    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbqfl\" (UniqueName: \"kubernetes.io/projected/1da8cc91-c2c3-4c57-a474-8029cbd5a735-kube-api-access-mbqfl\") pod \"llmisvc-controller-manager-777c6bd7d5-7qfk5\" (UID: \"1da8cc91-c2c3-4c57-a474-8029cbd5a735\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:39:58.553276 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.553234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e93b1aba-b926-4e19-992d-bdbd82583c17-cert\") pod \"kserve-controller-manager-d6f4b65b8-rtpmm\" (UID: \"e93b1aba-b926-4e19-992d-bdbd82583c17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"
Aug 03 23:39:58.553470 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.553348    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1da8cc91-c2c3-4c57-a474-8029cbd5a735-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7qfk5\" (UID: \"1da8cc91-c2c3-4c57-a474-8029cbd5a735\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:39:58.553470 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.553376    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24p7t\" (UniqueName: \"kubernetes.io/projected/e93b1aba-b926-4e19-992d-bdbd82583c17-kube-api-access-24p7t\") pod \"kserve-controller-manager-d6f4b65b8-rtpmm\" (UID: \"e93b1aba-b926-4e19-992d-bdbd82583c17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"
Aug 03 23:39:58.553470 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.553449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbqfl\" (UniqueName: \"kubernetes.io/projected/1da8cc91-c2c3-4c57-a474-8029cbd5a735-kube-api-access-mbqfl\") pod \"llmisvc-controller-manager-777c6bd7d5-7qfk5\" (UID: \"1da8cc91-c2c3-4c57-a474-8029cbd5a735\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:39:58.553645 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:39:58.553514    2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Aug 03 23:39:58.553645 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:39:58.553618    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da8cc91-c2c3-4c57-a474-8029cbd5a735-cert podName:1da8cc91-c2c3-4c57-a474-8029cbd5a735 nodeName:}" failed. No retries permitted until 2026-08-03 23:39:59.053593298 +0000 UTC m=+599.939921756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1da8cc91-c2c3-4c57-a474-8029cbd5a735-cert") pod "llmisvc-controller-manager-777c6bd7d5-7qfk5" (UID: "1da8cc91-c2c3-4c57-a474-8029cbd5a735") : secret "llmisvc-webhook-server-cert" not found
Aug 03 23:39:58.556668 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.556641    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e93b1aba-b926-4e19-992d-bdbd82583c17-cert\") pod \"kserve-controller-manager-d6f4b65b8-rtpmm\" (UID: \"e93b1aba-b926-4e19-992d-bdbd82583c17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"
Aug 03 23:39:58.565609 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.565584    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24p7t\" (UniqueName: \"kubernetes.io/projected/e93b1aba-b926-4e19-992d-bdbd82583c17-kube-api-access-24p7t\") pod \"kserve-controller-manager-d6f4b65b8-rtpmm\" (UID: \"e93b1aba-b926-4e19-992d-bdbd82583c17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"
Aug 03 23:39:58.565772 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.565722    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbqfl\" (UniqueName: \"kubernetes.io/projected/1da8cc91-c2c3-4c57-a474-8029cbd5a735-kube-api-access-mbqfl\") pod \"llmisvc-controller-manager-777c6bd7d5-7qfk5\" (UID: \"1da8cc91-c2c3-4c57-a474-8029cbd5a735\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:39:58.607750 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.607663    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:58.694866 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.694824    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:58.699751 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:58.699719    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"
Aug 03 23:39:59.058578 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.058541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1da8cc91-c2c3-4c57-a474-8029cbd5a735-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7qfk5\" (UID: \"1da8cc91-c2c3-4c57-a474-8029cbd5a735\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:39:59.061384 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.061353    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1da8cc91-c2c3-4c57-a474-8029cbd5a735-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7qfk5\" (UID: \"1da8cc91-c2c3-4c57-a474-8029cbd5a735\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:39:59.319480 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.319402    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:39:59.399592 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.399536    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:39:59.400022 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.399630    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:39:59.475299 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.475250    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"]
Aug 03 23:39:59.477874 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:39:59.477851    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93b1aba_b926_4e19_992d_bdbd82583c17.slice/crio-fa716adac8f473c29d5317701239e6f9c8ffcb3cbfa457b33e75a6c271058b34 WatchSource:0}: Error finding container fa716adac8f473c29d5317701239e6f9c8ffcb3cbfa457b33e75a6c271058b34: Status 404 returned error can't find the container with id fa716adac8f473c29d5317701239e6f9c8ffcb3cbfa457b33e75a6c271058b34
Aug 03 23:39:59.493801 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.493498    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"]
Aug 03 23:39:59.496363 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:39:59.496326    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1da8cc91_c2c3_4c57_a474_8029cbd5a735.slice/crio-60f28f0febb2b9028d60712d3c929e1237d63e63249aa417046748f70ac913dd WatchSource:0}: Error finding container 60f28f0febb2b9028d60712d3c929e1237d63e63249aa417046748f70ac913dd: Status 404 returned error can't find the container with id 60f28f0febb2b9028d60712d3c929e1237d63e63249aa417046748f70ac913dd
Aug 03 23:39:59.586251 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.586163    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:59.671110 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.671075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9" event={"ID":"d6e54191-770d-4f8e-bafe-8c13dc0a5070","Type":"ContainerStarted","Data":"57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827"}
Aug 03 23:39:59.671336 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.671195    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:39:59.672343 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.672314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm" event={"ID":"e93b1aba-b926-4e19-992d-bdbd82583c17","Type":"ContainerStarted","Data":"fa716adac8f473c29d5317701239e6f9c8ffcb3cbfa457b33e75a6c271058b34"}
Aug 03 23:39:59.673559 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.673533    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5" event={"ID":"1da8cc91-c2c3-4c57-a474-8029cbd5a735","Type":"ContainerStarted","Data":"60f28f0febb2b9028d60712d3c929e1237d63e63249aa417046748f70ac913dd"}
Aug 03 23:39:59.687326 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.687294    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:39:59.693741 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.693699    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9" podStartSLOduration=1.285898197 podStartE2EDuration="5.6936841s" totalImagesPullingTime="4.407785903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:39:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:39:59.692453888 +0000 UTC m=+600.578782354" watchObservedRunningTime="2026-08-03 23:39:59.6936841 +0000 UTC m=+600.580012566"
Aug 03 23:39:59.793402 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:39:59.793370    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:40:00.330650 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:00.330597    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:40:00.475230 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:00.475155    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:40:00.682682 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:00.682599    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-xh6l9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 03 23:40:00.682682 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:00.682657    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9" podUID="d6e54191-770d-4f8e-bafe-8c13dc0a5070" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 03 23:40:01.023341 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.023301    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"]
Aug 03 23:40:01.029356 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.029329    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.031974 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.031942    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kjdsh\""
Aug 03 23:40:01.038084 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.038055    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"]
Aug 03 23:40:01.064283 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.063865    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:40:01.076388 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.076348    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.076665 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.076642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.076803 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.076780    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.076942 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.076824    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.076942 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.076853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbgfp\" (UniqueName: \"kubernetes.io/projected/af9db11d-b10d-4d77-9e23-66cdbb999ad9-kube-api-access-nbgfp\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.076942 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.076900    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.077107 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.076958    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.077107 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.076992    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.077107 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.077016    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.178231 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178196    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.178525 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.178525 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.178525 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178361    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.178525 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.178525 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.178525 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178480    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.178525 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178513    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.179073 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbgfp\" (UniqueName: \"kubernetes.io/projected/af9db11d-b10d-4d77-9e23-66cdbb999ad9-kube-api-access-nbgfp\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.179073 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178692    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.179073 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178712    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.179073 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.178976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.179667 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.179647    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.179911 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.179889    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.181857 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.181830    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.182140 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.182114    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.191641 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.191563    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9db11d-b10d-4d77-9e23-66cdbb999ad9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.192005 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.191972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbgfp\" (UniqueName: \"kubernetes.io/projected/af9db11d-b10d-4d77-9e23-66cdbb999ad9-kube-api-access-nbgfp\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c75zgs\" (UID: \"af9db11d-b10d-4d77-9e23-66cdbb999ad9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.287146 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.287058    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:40:01.366334 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.366301    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:01.797925 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.797879    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"]
Aug 03 23:40:01.798437 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.798124    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9" podUID="d6e54191-770d-4f8e-bafe-8c13dc0a5070" containerName="discovery" containerID="cri-o://57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827" gracePeriod=30
Aug 03 23:40:01.798885 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:01.798850    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:40:02.492027 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.489884    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:40:02.590651 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.590576    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-kubeconfig\") pod \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") "
Aug 03 23:40:02.590651 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.590632    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e54191-770d-4f8e-bafe-8c13dc0a5070-local-certs\") pod \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") "
Aug 03 23:40:02.590848 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.590669    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-ca-configmap\") pod \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") "
Aug 03 23:40:02.591701 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.591004    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-token\") pod \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") "
Aug 03 23:40:02.591701 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.591051    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcfxn\" (UniqueName: \"kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-kube-api-access-qcfxn\") pod \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") "
Aug 03 23:40:02.591701 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.591088    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-dns-cert\") pod \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") "
Aug 03 23:40:02.591701 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.591136    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-cacerts\") pod \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\" (UID: \"d6e54191-770d-4f8e-bafe-8c13dc0a5070\") "
Aug 03 23:40:02.591701 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.591005    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "d6e54191-770d-4f8e-bafe-8c13dc0a5070" (UID: "d6e54191-770d-4f8e-bafe-8c13dc0a5070"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 03 23:40:02.598190 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.598083    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6e54191-770d-4f8e-bafe-8c13dc0a5070" (UID: "d6e54191-770d-4f8e-bafe-8c13dc0a5070"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:40:02.598682 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.598632    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-cacerts" (OuterVolumeSpecName: "cacerts") pod "d6e54191-770d-4f8e-bafe-8c13dc0a5070" (UID: "d6e54191-770d-4f8e-bafe-8c13dc0a5070"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 03 23:40:02.600806 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.600773    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6e54191-770d-4f8e-bafe-8c13dc0a5070-local-certs" (OuterVolumeSpecName: "local-certs") pod "d6e54191-770d-4f8e-bafe-8c13dc0a5070" (UID: "d6e54191-770d-4f8e-bafe-8c13dc0a5070"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:40:02.600912 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.600773    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "d6e54191-770d-4f8e-bafe-8c13dc0a5070" (UID: "d6e54191-770d-4f8e-bafe-8c13dc0a5070"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 03 23:40:02.600912 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.600868    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "d6e54191-770d-4f8e-bafe-8c13dc0a5070" (UID: "d6e54191-770d-4f8e-bafe-8c13dc0a5070"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 03 23:40:02.600912 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.600906    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-kube-api-access-qcfxn" (OuterVolumeSpecName: "kube-api-access-qcfxn") pod "d6e54191-770d-4f8e-bafe-8c13dc0a5070" (UID: "d6e54191-770d-4f8e-bafe-8c13dc0a5070"). InnerVolumeSpecName "kube-api-access-qcfxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:40:02.663633 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.663596    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"]
Aug 03 23:40:02.668137 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:40:02.668103    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9db11d_b10d_4d77_9e23_66cdbb999ad9.slice/crio-5acd7afb3e0a0f2512fb7bdfc9d8e81566d6774abf71ffcca499892497945dbd WatchSource:0}: Error finding container 5acd7afb3e0a0f2512fb7bdfc9d8e81566d6774abf71ffcca499892497945dbd: Status 404 returned error can't find the container with id 5acd7afb3e0a0f2512fb7bdfc9d8e81566d6774abf71ffcca499892497945dbd
Aug 03 23:40:02.690098 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.690059    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs" event={"ID":"af9db11d-b10d-4d77-9e23-66cdbb999ad9","Type":"ContainerStarted","Data":"5acd7afb3e0a0f2512fb7bdfc9d8e81566d6774abf71ffcca499892497945dbd"}
Aug 03 23:40:02.691594 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.691564    2568 generic.go:356] "Generic (PLEG): container finished" podID="d6e54191-770d-4f8e-bafe-8c13dc0a5070" containerID="57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827" exitCode=0
Aug 03 23:40:02.691758 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.691616    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"
Aug 03 23:40:02.691758 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.691660    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9" event={"ID":"d6e54191-770d-4f8e-bafe-8c13dc0a5070","Type":"ContainerDied","Data":"57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827"}
Aug 03 23:40:02.691758 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.691724    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9" event={"ID":"d6e54191-770d-4f8e-bafe-8c13dc0a5070","Type":"ContainerDied","Data":"5483b720abd6216fd764dd35e01507817857c7d67148810475c4f63ea7f46fa9"}
Aug 03 23:40:02.691758 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.691752    2568 scope.go:117] "RemoveContainer" containerID="57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827"
Aug 03 23:40:02.691987 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.691971    2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-kubeconfig\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:40:02.692042 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.691994    2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e54191-770d-4f8e-bafe-8c13dc0a5070-local-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:40:02.692042 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.692009    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-ca-configmap\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:40:02.692042 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.692024    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:40:02.692042 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.692038    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcfxn\" (UniqueName: \"kubernetes.io/projected/d6e54191-770d-4f8e-bafe-8c13dc0a5070-kube-api-access-qcfxn\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:40:02.692208 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.692051    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-istio-csr-dns-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:40:02.692208 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.692064    2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6e54191-770d-4f8e-bafe-8c13dc0a5070-cacerts\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:40:02.693585 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.693562    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm" event={"ID":"e93b1aba-b926-4e19-992d-bdbd82583c17","Type":"ContainerStarted","Data":"d0fd4144942ce00156411b4aca3f6e89451c7cf638dac6d1f0c41cff91f3b91d"}
Aug 03 23:40:02.693720 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.693635    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"
Aug 03 23:40:02.695378 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.695352    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5" event={"ID":"1da8cc91-c2c3-4c57-a474-8029cbd5a735","Type":"ContainerStarted","Data":"b3b3a874d228e64a639bb7f7e25655d8cdc6afba8d8eec083d412231afe17f76"}
Aug 03 23:40:02.695553 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.695510    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:40:02.701713 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.701694    2568 scope.go:117] "RemoveContainer" containerID="57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827"
Aug 03 23:40:02.701998 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:40:02.701978    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827\": container with ID starting with 57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827 not found: ID does not exist" containerID="57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827"
Aug 03 23:40:02.702049 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.702007    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827"} err="failed to get container status \"57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827\": rpc error: code = NotFound desc = could not find container \"57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827\": container with ID starting with 57497c846de52c3711831f2e25cbdbba8b37ff5da6ee8e1810b427ca234fb827 not found: ID does not exist"
Aug 03 23:40:02.723278 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.723157    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm" podStartSLOduration=1.69391377 podStartE2EDuration="4.723139973s" totalImagesPullingTime="3.029226203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:40:02.718895043 +0000 UTC m=+603.605223510" watchObservedRunningTime="2026-08-03 23:40:02.723139973 +0000 UTC m=+603.609468464"
Aug 03 23:40:02.745219 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.745165    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5" podStartSLOduration=1.730742662 podStartE2EDuration="4.745148818s" totalImagesPullingTime="3.014406156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:40:02.743940678 +0000 UTC m=+603.630269136" watchObservedRunningTime="2026-08-03 23:40:02.745148818 +0000 UTC m=+603.631477282"
Aug 03 23:40:02.765242 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.765210    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"]
Aug 03 23:40:02.770788 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:02.770764    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xh6l9"]
Aug 03 23:40:03.635314 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:03.635283    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-nhkdm"
Aug 03 23:40:03.660947 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:03.660904    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6e54191-770d-4f8e-bafe-8c13dc0a5070" path="/var/lib/kubelet/pods/d6e54191-770d-4f8e-bafe-8c13dc0a5070/volumes"
Aug 03 23:40:06.393972 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:06.393939    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:40:06.394382 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:06.394009    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:40:06.394382 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:06.394041    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:40:06.715996 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:06.715912    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs" event={"ID":"af9db11d-b10d-4d77-9e23-66cdbb999ad9","Type":"ContainerStarted","Data":"b72b0c10ffe4ace2b1ebc759c8f7208456f46c3ba4ddb7ddce55999c43c0ed42"}
Aug 03 23:40:06.735649 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:06.735594    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs" podStartSLOduration=2.01219627 podStartE2EDuration="5.735576895s" totalImagesPullingTime="3.723380625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:40:06.733708782 +0000 UTC m=+607.620037248" watchObservedRunningTime="2026-08-03 23:40:06.735576895 +0000 UTC m=+607.621905360"
Aug 03 23:40:07.367453 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:07.367409    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:07.372351 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:07.372319    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:07.720962 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:07.720933    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:07.722003 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:07.721985    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c75zgs"
Aug 03 23:40:33.704013 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:33.703940    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7qfk5"
Aug 03 23:40:33.707185 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:33.707164    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rtpmm"
Aug 03 23:40:48.622606 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:48.622558    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:40:49.099924 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:49.099888    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:40:49.205855 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:40:49.205821    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:00.034504 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:00.034469    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:00.830091 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:00.830052    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:01.629503 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:01.629461    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:04.597294 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.597244    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"]
Aug 03 23:41:04.597698 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.597530    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6e54191-770d-4f8e-bafe-8c13dc0a5070" containerName="discovery"
Aug 03 23:41:04.597698 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.597540    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6e54191-770d-4f8e-bafe-8c13dc0a5070" containerName="discovery"
Aug 03 23:41:04.597698 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.597599    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6e54191-770d-4f8e-bafe-8c13dc0a5070" containerName="discovery"
Aug 03 23:41:04.600482 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.600452    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:04.603074 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:41:04.603033    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:04.603074 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:41:04.603060    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Aug 03 23:41:04.603397 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.603372    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-q9ssh\""
Aug 03 23:41:04.603506 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.603463    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 03 23:41:04.615643 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.615615    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"]
Aug 03 23:41:04.720904 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.720867    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ccd763-2c80-45df-a692-e67aaa4721b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" (UID: \"56ccd763-2c80-45df-a692-e67aaa4721b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:04.721094 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.720933    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lrck\" (UniqueName: \"kubernetes.io/projected/56ccd763-2c80-45df-a692-e67aaa4721b1-kube-api-access-7lrck\") pod \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" (UID: \"56ccd763-2c80-45df-a692-e67aaa4721b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:04.766669 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.766633    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:04.822285 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.822223    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ccd763-2c80-45df-a692-e67aaa4721b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" (UID: \"56ccd763-2c80-45df-a692-e67aaa4721b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:04.822456 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.822311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lrck\" (UniqueName: \"kubernetes.io/projected/56ccd763-2c80-45df-a692-e67aaa4721b1-kube-api-access-7lrck\") pod \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" (UID: \"56ccd763-2c80-45df-a692-e67aaa4721b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:04.822708 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.822673    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ccd763-2c80-45df-a692-e67aaa4721b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" (UID: \"56ccd763-2c80-45df-a692-e67aaa4721b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:04.864233 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.864150    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:04.965173 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:04.965139    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:05.240005 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:05.239961    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:05.817500 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:05.817470    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 03 23:41:05.824014 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:05.823994    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lrck\" (UniqueName: \"kubernetes.io/projected/56ccd763-2c80-45df-a692-e67aaa4721b1-kube-api-access-7lrck\") pod \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" (UID: \"56ccd763-2c80-45df-a692-e67aaa4721b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:06.110069 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:06.109961    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:06.256091 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:06.256060    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"]
Aug 03 23:41:06.257422 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:41:06.257397    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ccd763_2c80_45df_a692_e67aaa4721b1.slice/crio-480c87106740bd318acfb5bc9bd27e932dbf1877a2179b98d781b9c52a6050cb WatchSource:0}: Error finding container 480c87106740bd318acfb5bc9bd27e932dbf1877a2179b98d781b9c52a6050cb: Status 404 returned error can't find the container with id 480c87106740bd318acfb5bc9bd27e932dbf1877a2179b98d781b9c52a6050cb
Aug 03 23:41:06.280080 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:06.280044    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:06.383315 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:06.383192    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:06.843998 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:06.843964    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:06.943768 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:06.943737    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:06.960838 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:06.960809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh" event={"ID":"56ccd763-2c80-45df-a692-e67aaa4721b1","Type":"ContainerStarted","Data":"480c87106740bd318acfb5bc9bd27e932dbf1877a2179b98d781b9c52a6050cb"}
Aug 03 23:41:07.193096 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.192998    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-x26hc"]
Aug 03 23:41:07.195618 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.195598    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-x26hc"
Aug 03 23:41:07.198797 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.198772    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mf5c8\""
Aug 03 23:41:07.212548 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.212522    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-x26hc"]
Aug 03 23:41:07.242163 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.242028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m997\" (UniqueName: \"kubernetes.io/projected/3ea39c69-4ec6-41d5-8244-fabee7f42804-kube-api-access-8m997\") pod \"authorino-operator-68d88948d8-x26hc\" (UID: \"3ea39c69-4ec6-41d5-8244-fabee7f42804\") " pod="kuadrant-system/authorino-operator-68d88948d8-x26hc"
Aug 03 23:41:07.343009 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.342961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m997\" (UniqueName: \"kubernetes.io/projected/3ea39c69-4ec6-41d5-8244-fabee7f42804-kube-api-access-8m997\") pod \"authorino-operator-68d88948d8-x26hc\" (UID: \"3ea39c69-4ec6-41d5-8244-fabee7f42804\") " pod="kuadrant-system/authorino-operator-68d88948d8-x26hc"
Aug 03 23:41:07.354776 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.354744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m997\" (UniqueName: \"kubernetes.io/projected/3ea39c69-4ec6-41d5-8244-fabee7f42804-kube-api-access-8m997\") pod \"authorino-operator-68d88948d8-x26hc\" (UID: \"3ea39c69-4ec6-41d5-8244-fabee7f42804\") " pod="kuadrant-system/authorino-operator-68d88948d8-x26hc"
Aug 03 23:41:07.508865 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.508832    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-x26hc"
Aug 03 23:41:07.691480 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.691446    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-x26hc"]
Aug 03 23:41:07.697918 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:41:07.697886    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea39c69_4ec6_41d5_8244_fabee7f42804.slice/crio-e1508007268475d7187709fb01ad8ecc57dda2d353e971a9d81b83789645a513 WatchSource:0}: Error finding container e1508007268475d7187709fb01ad8ecc57dda2d353e971a9d81b83789645a513: Status 404 returned error can't find the container with id e1508007268475d7187709fb01ad8ecc57dda2d353e971a9d81b83789645a513
Aug 03 23:41:07.844622 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.844526    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:07.970367 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:07.970327    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-x26hc" event={"ID":"3ea39c69-4ec6-41d5-8244-fabee7f42804","Type":"ContainerStarted","Data":"e1508007268475d7187709fb01ad8ecc57dda2d353e971a9d81b83789645a513"}
Aug 03 23:41:08.487123 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:08.487055    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:10.044663 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:10.044603    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:10.986195 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:10.986156    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh" event={"ID":"56ccd763-2c80-45df-a692-e67aaa4721b1","Type":"ContainerStarted","Data":"8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1"}
Aug 03 23:41:10.986431 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:10.986284    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:10.987631 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:10.987609    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-x26hc" event={"ID":"3ea39c69-4ec6-41d5-8244-fabee7f42804","Type":"ContainerStarted","Data":"e8ee6618c21f9fdf79314d6a82e6c79b9c3a2bda764857368383482324a7ceb8"}
Aug 03 23:41:10.987760 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:10.987738    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-x26hc"
Aug 03 23:41:11.010065 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.010017    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh" podStartSLOduration=2.74684191 podStartE2EDuration="7.010003163s" totalImagesPullingTime="4.263161253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:41:11.008555785 +0000 UTC m=+671.894884251" watchObservedRunningTime="2026-08-03 23:41:11.010003163 +0000 UTC m=+671.896331628"
Aug 03 23:41:11.029554 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.029502    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-x26hc" podStartSLOduration=1.220759259 podStartE2EDuration="4.029483526s" totalImagesPullingTime="2.808724267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:41:11.028968309 +0000 UTC m=+671.915296773" watchObservedRunningTime="2026-08-03 23:41:11.029483526 +0000 UTC m=+671.915811991"
Aug 03 23:41:11.085315 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.085277    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:11.517577 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.517546    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh"]
Aug 03 23:41:11.519981 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.519960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh"
Aug 03 23:41:11.522202 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.522185    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 03 23:41:11.522321 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.522227    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bxdr4\""
Aug 03 23:41:11.531934 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.531908    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh"]
Aug 03 23:41:11.584880 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.584851    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjqb\" (UniqueName: \"kubernetes.io/projected/2292371f-07b4-4ebc-ac50-5a2b99368697-kube-api-access-lmjqb\") pod \"dns-operator-controller-manager-5985564776-j6gkh\" (UID: \"2292371f-07b4-4ebc-ac50-5a2b99368697\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh"
Aug 03 23:41:11.686340 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.686305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjqb\" (UniqueName: \"kubernetes.io/projected/2292371f-07b4-4ebc-ac50-5a2b99368697-kube-api-access-lmjqb\") pod \"dns-operator-controller-manager-5985564776-j6gkh\" (UID: \"2292371f-07b4-4ebc-ac50-5a2b99368697\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh"
Aug 03 23:41:11.697902 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.697872    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjqb\" (UniqueName: \"kubernetes.io/projected/2292371f-07b4-4ebc-ac50-5a2b99368697-kube-api-access-lmjqb\") pod \"dns-operator-controller-manager-5985564776-j6gkh\" (UID: \"2292371f-07b4-4ebc-ac50-5a2b99368697\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh"
Aug 03 23:41:11.829902 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.829810    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh"
Aug 03 23:41:11.963353 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.963328    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh"]
Aug 03 23:41:11.965936 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:41:11.965901    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2292371f_07b4_4ebc_ac50_5a2b99368697.slice/crio-a7e54674c3b2f3eb954836f7485597309b2096ebc99679b28c755479b07db1da WatchSource:0}: Error finding container a7e54674c3b2f3eb954836f7485597309b2096ebc99679b28c755479b07db1da: Status 404 returned error can't find the container with id a7e54674c3b2f3eb954836f7485597309b2096ebc99679b28c755479b07db1da
Aug 03 23:41:11.995075 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:11.995030    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh" event={"ID":"2292371f-07b4-4ebc-ac50-5a2b99368697","Type":"ContainerStarted","Data":"a7e54674c3b2f3eb954836f7485597309b2096ebc99679b28c755479b07db1da"}
Aug 03 23:41:13.336465 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:13.336421    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:13.437051 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:13.437017    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:15.273850 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:15.273809    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:15.374346 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:15.374313    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:15.634793 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:15.634675    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:15.690565 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:15.690538    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:16.039856 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:16.039789    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:16.139669 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:16.139639    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:17.018397 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:17.018364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh" event={"ID":"2292371f-07b4-4ebc-ac50-5a2b99368697","Type":"ContainerStarted","Data":"323c1460b50f48abf7d31a525758ec8d6fae186e2fb20cab2fefd8d27f18102d"}
Aug 03 23:41:17.018831 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:17.018427    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh"
Aug 03 23:41:17.037298 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:17.037230    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh" podStartSLOduration=1.130465211 podStartE2EDuration="6.037212861s" totalImagesPullingTime="4.90674765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:41:17.036354358 +0000 UTC m=+677.922682824" watchObservedRunningTime="2026-08-03 23:41:17.037212861 +0000 UTC m=+677.923541331"
Aug 03 23:41:21.997060 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:21.997026    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-x26hc"
Aug 03 23:41:21.997665 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:21.997095    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:23.669303 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.669243    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"]
Aug 03 23:41:23.669818 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.669502    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" containerName="manager" containerID="cri-o://8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1" gracePeriod=2
Aug 03 23:41:23.673326 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.673297    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"]
Aug 03 23:41:23.691073 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.691034    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"]
Aug 03 23:41:23.691571 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.691551    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" containerName="manager"
Aug 03 23:41:23.691571 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.691571    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" containerName="manager"
Aug 03 23:41:23.691762 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.691667    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" containerName="manager"
Aug 03 23:41:23.693953 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.693933    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:23.695954 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:41:23.695921    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:23.706775 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.706740    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"]
Aug 03 23:41:23.796426 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.796394    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfc31fa4-ad7d-4029-a8a3-f05f97532545-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-28bc8\" (UID: \"cfc31fa4-ad7d-4029-a8a3-f05f97532545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:23.796576 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.796468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t874b\" (UniqueName: \"kubernetes.io/projected/cfc31fa4-ad7d-4029-a8a3-f05f97532545-kube-api-access-t874b\") pod \"kuadrant-operator-controller-manager-58fc56757c-28bc8\" (UID: \"cfc31fa4-ad7d-4029-a8a3-f05f97532545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:23.897704 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.897670    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfc31fa4-ad7d-4029-a8a3-f05f97532545-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-28bc8\" (UID: \"cfc31fa4-ad7d-4029-a8a3-f05f97532545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:23.897833 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.897768    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t874b\" (UniqueName: \"kubernetes.io/projected/cfc31fa4-ad7d-4029-a8a3-f05f97532545-kube-api-access-t874b\") pod \"kuadrant-operator-controller-manager-58fc56757c-28bc8\" (UID: \"cfc31fa4-ad7d-4029-a8a3-f05f97532545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:23.898118 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.898098    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfc31fa4-ad7d-4029-a8a3-f05f97532545-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-28bc8\" (UID: \"cfc31fa4-ad7d-4029-a8a3-f05f97532545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:23.907928 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.907899    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t874b\" (UniqueName: \"kubernetes.io/projected/cfc31fa4-ad7d-4029-a8a3-f05f97532545-kube-api-access-t874b\") pod \"kuadrant-operator-controller-manager-58fc56757c-28bc8\" (UID: \"cfc31fa4-ad7d-4029-a8a3-f05f97532545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:23.910177 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:23.910160    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:23.912825 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:41:23.912795    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:24.042567 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.042536    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:24.049189 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.049159    2568 generic.go:356] "Generic (PLEG): container finished" podID="56ccd763-2c80-45df-a692-e67aaa4721b1" containerID="8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1" exitCode=0
Aug 03 23:41:24.049347 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.049217    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:24.049347 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.049276    2568 scope.go:117] "RemoveContainer" containerID="8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1"
Aug 03 23:41:24.051759 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:41:24.051715    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:24.061146 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.061116    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:24.061659 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.061638    2568 scope.go:117] "RemoveContainer" containerID="8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1"
Aug 03 23:41:24.061927 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:41:24.061908    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1\": container with ID starting with 8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1 not found: ID does not exist" containerID="8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1"
Aug 03 23:41:24.062009 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.061940    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1"} err="failed to get container status \"8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1\": rpc error: code = NotFound desc = could not find container \"8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1\": container with ID starting with 8a2a888459fa4b60159690613f869bd38623515d225021f8036f06537b92f5c1 not found: ID does not exist"
Aug 03 23:41:24.099290 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.099224    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ccd763-2c80-45df-a692-e67aaa4721b1-extensions-socket-volume\") pod \"56ccd763-2c80-45df-a692-e67aaa4721b1\" (UID: \"56ccd763-2c80-45df-a692-e67aaa4721b1\") "
Aug 03 23:41:24.099428 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.099342    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lrck\" (UniqueName: \"kubernetes.io/projected/56ccd763-2c80-45df-a692-e67aaa4721b1-kube-api-access-7lrck\") pod \"56ccd763-2c80-45df-a692-e67aaa4721b1\" (UID: \"56ccd763-2c80-45df-a692-e67aaa4721b1\") "
Aug 03 23:41:24.099961 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.099931    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56ccd763-2c80-45df-a692-e67aaa4721b1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "56ccd763-2c80-45df-a692-e67aaa4721b1" (UID: "56ccd763-2c80-45df-a692-e67aaa4721b1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:41:24.102419 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.102388    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56ccd763-2c80-45df-a692-e67aaa4721b1-kube-api-access-7lrck" (OuterVolumeSpecName: "kube-api-access-7lrck") pod "56ccd763-2c80-45df-a692-e67aaa4721b1" (UID: "56ccd763-2c80-45df-a692-e67aaa4721b1"). InnerVolumeSpecName "kube-api-access-7lrck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:41:24.163237 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.163204    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:24.181311 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.181279    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"]
Aug 03 23:41:24.185201 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:41:24.185172    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc31fa4_ad7d_4029_a8a3_f05f97532545.slice/crio-307bff3a70aa7c48323c179bd0a68f7b144f39fcf5d45b4d4bb951fd7ac2f7f3 WatchSource:0}: Error finding container 307bff3a70aa7c48323c179bd0a68f7b144f39fcf5d45b4d4bb951fd7ac2f7f3: Status 404 returned error can't find the container with id 307bff3a70aa7c48323c179bd0a68f7b144f39fcf5d45b4d4bb951fd7ac2f7f3
Aug 03 23:41:24.200477 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.200460    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ccd763-2c80-45df-a692-e67aaa4721b1-extensions-socket-volume\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:41:24.200547 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.200480    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lrck\" (UniqueName: \"kubernetes.io/projected/56ccd763-2c80-45df-a692-e67aaa4721b1-kube-api-access-7lrck\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:41:24.359793 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:41:24.359763    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:24.639466 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.639387    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"]
Aug 03 23:41:24.641829 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.641808    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:41:24.655938 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.655914    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"]
Aug 03 23:41:24.675904 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:41:24.675861    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:24.805247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.805202    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjjf8\" (UniqueName: \"kubernetes.io/projected/ed590a2a-c05f-4ff9-a349-6f9145773e8a-kube-api-access-fjjf8\") pod \"kuadrant-operator-controller-manager-68cf589589-s8hbj\" (UID: \"ed590a2a-c05f-4ff9-a349-6f9145773e8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:41:24.805448 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.805362    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed590a2a-c05f-4ff9-a349-6f9145773e8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-s8hbj\" (UID: \"ed590a2a-c05f-4ff9-a349-6f9145773e8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:41:24.906646 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.906556    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjjf8\" (UniqueName: \"kubernetes.io/projected/ed590a2a-c05f-4ff9-a349-6f9145773e8a-kube-api-access-fjjf8\") pod \"kuadrant-operator-controller-manager-68cf589589-s8hbj\" (UID: \"ed590a2a-c05f-4ff9-a349-6f9145773e8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:41:24.906646 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.906620    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed590a2a-c05f-4ff9-a349-6f9145773e8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-s8hbj\" (UID: \"ed590a2a-c05f-4ff9-a349-6f9145773e8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:41:24.906948 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.906932    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed590a2a-c05f-4ff9-a349-6f9145773e8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-s8hbj\" (UID: \"ed590a2a-c05f-4ff9-a349-6f9145773e8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:41:24.916008 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.915978    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjjf8\" (UniqueName: \"kubernetes.io/projected/ed590a2a-c05f-4ff9-a349-6f9145773e8a-kube-api-access-fjjf8\") pod \"kuadrant-operator-controller-manager-68cf589589-s8hbj\" (UID: \"ed590a2a-c05f-4ff9-a349-6f9145773e8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:41:24.951862 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:24.951822    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:41:25.059613 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:25.058662    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8" event={"ID":"cfc31fa4-ad7d-4029-a8a3-f05f97532545","Type":"ContainerStarted","Data":"0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88"}
Aug 03 23:41:25.059613 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:25.058729    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8" event={"ID":"cfc31fa4-ad7d-4029-a8a3-f05f97532545","Type":"ContainerStarted","Data":"307bff3a70aa7c48323c179bd0a68f7b144f39fcf5d45b4d4bb951fd7ac2f7f3"}
Aug 03 23:41:25.059613 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:25.059321    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:25.065316 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:41:25.064463    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vqmxh\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vqmxh"
Aug 03 23:41:25.101727 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:25.101669    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8" podStartSLOduration=2.101651036 podStartE2EDuration="2.101651036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:41:25.099301354 +0000 UTC m=+685.985629840" watchObservedRunningTime="2026-08-03 23:41:25.101651036 +0000 UTC m=+685.987979501"
Aug 03 23:41:25.127396 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:25.127211    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"]
Aug 03 23:41:25.130322 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:41:25.130298    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded590a2a_c05f_4ff9_a349_6f9145773e8a.slice/crio-def1e4bd895da8140d04b1be86395446ca0727dc099015ee85837c07b4b00f6a WatchSource:0}: Error finding container def1e4bd895da8140d04b1be86395446ca0727dc099015ee85837c07b4b00f6a: Status 404 returned error can't find the container with id def1e4bd895da8140d04b1be86395446ca0727dc099015ee85837c07b4b00f6a
Aug 03 23:41:25.660492 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:25.660455    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56ccd763-2c80-45df-a692-e67aaa4721b1" path="/var/lib/kubelet/pods/56ccd763-2c80-45df-a692-e67aaa4721b1/volumes"
Aug 03 23:41:26.072877 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:26.072842    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj" event={"ID":"ed590a2a-c05f-4ff9-a349-6f9145773e8a","Type":"ContainerStarted","Data":"1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403"}
Aug 03 23:41:26.073306 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:26.072899    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj" event={"ID":"ed590a2a-c05f-4ff9-a349-6f9145773e8a","Type":"ContainerStarted","Data":"def1e4bd895da8140d04b1be86395446ca0727dc099015ee85837c07b4b00f6a"}
Aug 03 23:41:26.073306 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:26.073019    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:41:26.095032 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:26.094973    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj" podStartSLOduration=2.094955362 podStartE2EDuration="2.094955362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:41:26.092516102 +0000 UTC m=+686.978844615" watchObservedRunningTime="2026-08-03 23:41:26.094955362 +0000 UTC m=+686.981283827"
Aug 03 23:41:27.047048 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:27.046990    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:27.149938 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:27.149888    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:28.025404 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:28.025377    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-j6gkh"
Aug 03 23:41:29.490933 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:29.490897    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:29.550698 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:29.550664    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:30.682723 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:30.682683    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:30.785808 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:30.785778    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:36.074906 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:36.074866    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:36.474210 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:36.474180    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:36.575737 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:36.575701    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:36.871710 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:36.871588    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:36.971494 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:36.971460    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:37.071246 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.071210    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:37.079783 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.079760    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:41:37.127383 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.127301    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"]
Aug 03 23:41:37.127542 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.127520    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8" podUID="cfc31fa4-ad7d-4029-a8a3-f05f97532545" containerName="manager" containerID="cri-o://0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88" gracePeriod=10
Aug 03 23:41:37.138845 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.138816    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:37.376689 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.376666    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:37.406572 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.406496    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfc31fa4-ad7d-4029-a8a3-f05f97532545-extensions-socket-volume\") pod \"cfc31fa4-ad7d-4029-a8a3-f05f97532545\" (UID: \"cfc31fa4-ad7d-4029-a8a3-f05f97532545\") "
Aug 03 23:41:37.406732 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.406579    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t874b\" (UniqueName: \"kubernetes.io/projected/cfc31fa4-ad7d-4029-a8a3-f05f97532545-kube-api-access-t874b\") pod \"cfc31fa4-ad7d-4029-a8a3-f05f97532545\" (UID: \"cfc31fa4-ad7d-4029-a8a3-f05f97532545\") "
Aug 03 23:41:37.406914 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.406890    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc31fa4-ad7d-4029-a8a3-f05f97532545-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cfc31fa4-ad7d-4029-a8a3-f05f97532545" (UID: "cfc31fa4-ad7d-4029-a8a3-f05f97532545"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:41:37.408756 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.408723    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc31fa4-ad7d-4029-a8a3-f05f97532545-kube-api-access-t874b" (OuterVolumeSpecName: "kube-api-access-t874b") pod "cfc31fa4-ad7d-4029-a8a3-f05f97532545" (UID: "cfc31fa4-ad7d-4029-a8a3-f05f97532545"). InnerVolumeSpecName "kube-api-access-t874b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:41:37.507860 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.507827    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t874b\" (UniqueName: \"kubernetes.io/projected/cfc31fa4-ad7d-4029-a8a3-f05f97532545-kube-api-access-t874b\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:41:37.507860 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:37.507859    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfc31fa4-ad7d-4029-a8a3-f05f97532545-extensions-socket-volume\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:41:38.131328 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:38.131295    2568 generic.go:356] "Generic (PLEG): container finished" podID="cfc31fa4-ad7d-4029-a8a3-f05f97532545" containerID="0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88" exitCode=0
Aug 03 23:41:38.131328 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:38.131327    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"
Aug 03 23:41:38.131893 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:38.131381    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8" event={"ID":"cfc31fa4-ad7d-4029-a8a3-f05f97532545","Type":"ContainerDied","Data":"0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88"}
Aug 03 23:41:38.131893 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:38.131442    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8" event={"ID":"cfc31fa4-ad7d-4029-a8a3-f05f97532545","Type":"ContainerDied","Data":"307bff3a70aa7c48323c179bd0a68f7b144f39fcf5d45b4d4bb951fd7ac2f7f3"}
Aug 03 23:41:38.131893 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:38.131476    2568 scope.go:117] "RemoveContainer" containerID="0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88"
Aug 03 23:41:38.140027 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:38.140005    2568 scope.go:117] "RemoveContainer" containerID="0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88"
Aug 03 23:41:38.140251 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:41:38.140232    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88\": container with ID starting with 0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88 not found: ID does not exist" containerID="0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88"
Aug 03 23:41:38.140333 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:38.140284    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88"} err="failed to get container status \"0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88\": rpc error: code = NotFound desc = could not find container \"0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88\": container with ID starting with 0d49b119eb439bb7a57e50764ebfd057270b74c61ab18d39b06e648f0db0ba88 not found: ID does not exist"
Aug 03 23:41:38.150068 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:38.150036    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"]
Aug 03 23:41:38.158947 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:38.158907    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-28bc8"]
Aug 03 23:41:39.659848 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:39.659814    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfc31fa4-ad7d-4029-a8a3-f05f97532545" path="/var/lib/kubelet/pods/cfc31fa4-ad7d-4029-a8a3-f05f97532545/volumes"
Aug 03 23:41:45.868876 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:45.868846    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:45.968543 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:45.968512    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:48.859930 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:48.859894    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:48.964756 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:48.964720    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:51.316252 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:51.316161    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:51.370472 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:51.370414    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:53.409126 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.409081    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"]
Aug 03 23:41:53.409630 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.409562    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc31fa4-ad7d-4029-a8a3-f05f97532545" containerName="manager"
Aug 03 23:41:53.409630 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.409580    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc31fa4-ad7d-4029-a8a3-f05f97532545" containerName="manager"
Aug 03 23:41:53.409746 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.409688    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc31fa4-ad7d-4029-a8a3-f05f97532545" containerName="manager"
Aug 03 23:41:53.412452 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.412433    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.414918 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.414895    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7fkf8\""
Aug 03 23:41:53.421901 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.421878    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"]
Aug 03 23:41:53.436594 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.436548    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:53.549892 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.549857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fszr2\" (UniqueName: \"kubernetes.io/projected/097c62e4-1209-4de6-83c5-5b6edf3bc128-kube-api-access-fszr2\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.549892 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.549892    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.550096 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.549925    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.550096 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.549975    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/097c62e4-1209-4de6-83c5-5b6edf3bc128-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.550096 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.550019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.550096 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.550040    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.550096 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.550092    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.550247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.550114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.550247 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.550131    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.651540 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.651505    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.651540 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.651547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.651811 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.651568    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.651811 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.651600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fszr2\" (UniqueName: \"kubernetes.io/projected/097c62e4-1209-4de6-83c5-5b6edf3bc128-kube-api-access-fszr2\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.651811 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.651628    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.651811 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.651664    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.651811 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.651698    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/097c62e4-1209-4de6-83c5-5b6edf3bc128-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.651811 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.651738    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.651811 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.651767    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.652155 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.651980    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.652155 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.652033    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.652155 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.652096    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.652361 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.652330    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.652512 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.652494    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/097c62e4-1209-4de6-83c5-5b6edf3bc128-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.654383 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.654358    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.654496 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.654442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.660081 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.660010    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/097c62e4-1209-4de6-83c5-5b6edf3bc128-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.660081 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.660065    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fszr2\" (UniqueName: \"kubernetes.io/projected/097c62e4-1209-4de6-83c5-5b6edf3bc128-kube-api-access-fszr2\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mxp6r\" (UID: \"097c62e4-1209-4de6-83c5-5b6edf3bc128\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.724055 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.724029    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:53.864024 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.863993    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"]
Aug 03 23:41:53.867698 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:41:53.867653    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097c62e4_1209_4de6_83c5_5b6edf3bc128.slice/crio-d9419257148b7ab23534adae9ae1e2abe647f799e040cda51015e6b19b6b38f0 WatchSource:0}: Error finding container d9419257148b7ab23534adae9ae1e2abe647f799e040cda51015e6b19b6b38f0: Status 404 returned error can't find the container with id d9419257148b7ab23534adae9ae1e2abe647f799e040cda51015e6b19b6b38f0
Aug 03 23:41:53.869888 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.869853    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:41:53.869970 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.869925    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:41:53.869970 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:53.869958    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:41:54.206745 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:54.206655    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" event={"ID":"097c62e4-1209-4de6-83c5-5b6edf3bc128","Type":"ContainerStarted","Data":"86ce7f2f269c6584e685ba2d85ca182b6dd1a46415c14dc312234476541a59aa"}
Aug 03 23:41:54.206745 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:54.206711    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" event={"ID":"097c62e4-1209-4de6-83c5-5b6edf3bc128","Type":"ContainerStarted","Data":"d9419257148b7ab23534adae9ae1e2abe647f799e040cda51015e6b19b6b38f0"}
Aug 03 23:41:54.228356 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:54.228298    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" podStartSLOduration=1.228275136 podStartE2EDuration="1.228275136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:41:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:41:54.226796044 +0000 UTC m=+715.113124532" watchObservedRunningTime="2026-08-03 23:41:54.228275136 +0000 UTC m=+715.114603596"
Aug 03 23:41:54.234645 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:54.234616    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:54.724238 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:54.724199    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:54.729401 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:54.729376    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:55.195142 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.195054    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:55.211949 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.211920    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:55.213190 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.213166    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:41:55.289071 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.289015    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:55.343418 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.343374    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:55.575923 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.575889    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:41:55.579074 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.579055    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"
Aug 03 23:41:55.581453 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.581436    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m8rpf\""
Aug 03 23:41:55.581550 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.581437    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 03 23:41:55.589618 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.589595    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:41:55.615859 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.615828    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:41:55.666961 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.666923    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pczmw\" (UniqueName: \"kubernetes.io/projected/1b0c09eb-99c4-4ea4-9688-db51fc584b42-kube-api-access-pczmw\") pod \"limitador-limitador-85d9db4d5d-bbwgk\" (UID: \"1b0c09eb-99c4-4ea4-9688-db51fc584b42\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"
Aug 03 23:41:55.667141 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.667032    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1b0c09eb-99c4-4ea4-9688-db51fc584b42-config-file\") pod \"limitador-limitador-85d9db4d5d-bbwgk\" (UID: \"1b0c09eb-99c4-4ea4-9688-db51fc584b42\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"
Aug 03 23:41:55.767994 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.767960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1b0c09eb-99c4-4ea4-9688-db51fc584b42-config-file\") pod \"limitador-limitador-85d9db4d5d-bbwgk\" (UID: \"1b0c09eb-99c4-4ea4-9688-db51fc584b42\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"
Aug 03 23:41:55.768487 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.768047    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pczmw\" (UniqueName: \"kubernetes.io/projected/1b0c09eb-99c4-4ea4-9688-db51fc584b42-kube-api-access-pczmw\") pod \"limitador-limitador-85d9db4d5d-bbwgk\" (UID: \"1b0c09eb-99c4-4ea4-9688-db51fc584b42\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"
Aug 03 23:41:55.768762 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.768740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1b0c09eb-99c4-4ea4-9688-db51fc584b42-config-file\") pod \"limitador-limitador-85d9db4d5d-bbwgk\" (UID: \"1b0c09eb-99c4-4ea4-9688-db51fc584b42\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"
Aug 03 23:41:55.776154 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.776125    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pczmw\" (UniqueName: \"kubernetes.io/projected/1b0c09eb-99c4-4ea4-9688-db51fc584b42-kube-api-access-pczmw\") pod \"limitador-limitador-85d9db4d5d-bbwgk\" (UID: \"1b0c09eb-99c4-4ea4-9688-db51fc584b42\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"
Aug 03 23:41:55.889978 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:55.889893    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"
Aug 03 23:41:56.009661 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.009632    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-d6vhv"]
Aug 03 23:41:56.013105 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.013082    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-d6vhv"
Aug 03 23:41:56.016090 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.016051    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-w24fk\""
Aug 03 23:41:56.020710 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.020677    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-d6vhv"]
Aug 03 23:41:56.037468 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.037438    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:41:56.040443 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:41:56.040416    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0c09eb_99c4_4ea4_9688_db51fc584b42.slice/crio-5cf7ffadb31ee61ed6c5cbe78ebc68ac916f0118242b094a8a157e09d98b15a2 WatchSource:0}: Error finding container 5cf7ffadb31ee61ed6c5cbe78ebc68ac916f0118242b094a8a157e09d98b15a2: Status 404 returned error can't find the container with id 5cf7ffadb31ee61ed6c5cbe78ebc68ac916f0118242b094a8a157e09d98b15a2
Aug 03 23:41:56.042674 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.042649    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 03 23:41:56.043461 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.043435    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:56.071090 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.071061    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf7r8\" (UniqueName: \"kubernetes.io/projected/7b108191-350e-44a3-81a0-e649ea409d0e-kube-api-access-sf7r8\") pod \"authorino-b54df94b4-d6vhv\" (UID: \"7b108191-350e-44a3-81a0-e649ea409d0e\") " pod="kuadrant-system/authorino-b54df94b4-d6vhv"
Aug 03 23:41:56.132992 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.132964    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:41:56.172289 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.172168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf7r8\" (UniqueName: \"kubernetes.io/projected/7b108191-350e-44a3-81a0-e649ea409d0e-kube-api-access-sf7r8\") pod \"authorino-b54df94b4-d6vhv\" (UID: \"7b108191-350e-44a3-81a0-e649ea409d0e\") " pod="kuadrant-system/authorino-b54df94b4-d6vhv"
Aug 03 23:41:56.180078 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.180047    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf7r8\" (UniqueName: \"kubernetes.io/projected/7b108191-350e-44a3-81a0-e649ea409d0e-kube-api-access-sf7r8\") pod \"authorino-b54df94b4-d6vhv\" (UID: \"7b108191-350e-44a3-81a0-e649ea409d0e\") " pod="kuadrant-system/authorino-b54df94b4-d6vhv"
Aug 03 23:41:56.216962 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.216923    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk" event={"ID":"1b0c09eb-99c4-4ea4-9688-db51fc584b42","Type":"ContainerStarted","Data":"5cf7ffadb31ee61ed6c5cbe78ebc68ac916f0118242b094a8a157e09d98b15a2"}
Aug 03 23:41:56.325443 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.325410    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-d6vhv"
Aug 03 23:41:56.456310 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:56.456159    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-d6vhv"]
Aug 03 23:41:56.458779 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:41:56.458747    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b108191_350e_44a3_81a0_e649ea409d0e.slice/crio-23eb8456dc939e53da6d5c8cfbe0f4264340f7d5dd20ddcf909ae2b3d017b8cb WatchSource:0}: Error finding container 23eb8456dc939e53da6d5c8cfbe0f4264340f7d5dd20ddcf909ae2b3d017b8cb: Status 404 returned error can't find the container with id 23eb8456dc939e53da6d5c8cfbe0f4264340f7d5dd20ddcf909ae2b3d017b8cb
Aug 03 23:41:57.223964 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:57.223934    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-d6vhv" event={"ID":"7b108191-350e-44a3-81a0-e649ea409d0e","Type":"ContainerStarted","Data":"23eb8456dc939e53da6d5c8cfbe0f4264340f7d5dd20ddcf909ae2b3d017b8cb"}
Aug 03 23:41:58.230369 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:58.230325    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk" event={"ID":"1b0c09eb-99c4-4ea4-9688-db51fc584b42","Type":"ContainerStarted","Data":"a832bd06efe112da74d88ccc0f44786b749ee5acbfec441cda84067031945920"}
Aug 03 23:41:58.230834 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:58.230451    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"
Aug 03 23:41:58.249371 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:58.249323    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk" podStartSLOduration=2.093487829 podStartE2EDuration="3.249307632s" totalImagesPullingTime="1.155819803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:41:58.247225354 +0000 UTC m=+719.133553819" watchObservedRunningTime="2026-08-03 23:41:58.249307632 +0000 UTC m=+719.135636097"
Aug 03 23:41:59.237729 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:59.237695    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-d6vhv" event={"ID":"7b108191-350e-44a3-81a0-e649ea409d0e","Type":"ContainerStarted","Data":"11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04"}
Aug 03 23:41:59.251557 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:59.251510    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-d6vhv" podStartSLOduration=1.5801599450000001 podStartE2EDuration="4.251494229s" totalImagesPullingTime="2.671334284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:41:59.250614515 +0000 UTC m=+720.136942983" watchObservedRunningTime="2026-08-03 23:41:59.251494229 +0000 UTC m=+720.137822693"
Aug 03 23:41:59.558698 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:41:59.558664    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-d6vhv"]
Aug 03 23:42:01.246218 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:01.246155    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-d6vhv" podUID="7b108191-350e-44a3-81a0-e649ea409d0e" containerName="authorino" containerID="cri-o://11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04" gracePeriod=30
Aug 03 23:42:01.501174 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:01.501111    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-d6vhv"
Aug 03 23:42:01.622637 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:01.622585    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf7r8\" (UniqueName: \"kubernetes.io/projected/7b108191-350e-44a3-81a0-e649ea409d0e-kube-api-access-sf7r8\") pod \"7b108191-350e-44a3-81a0-e649ea409d0e\" (UID: \"7b108191-350e-44a3-81a0-e649ea409d0e\") "
Aug 03 23:42:01.624963 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:01.624926    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b108191-350e-44a3-81a0-e649ea409d0e-kube-api-access-sf7r8" (OuterVolumeSpecName: "kube-api-access-sf7r8") pod "7b108191-350e-44a3-81a0-e649ea409d0e" (UID: "7b108191-350e-44a3-81a0-e649ea409d0e"). InnerVolumeSpecName "kube-api-access-sf7r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:42:01.723518 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:01.723481    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf7r8\" (UniqueName: \"kubernetes.io/projected/7b108191-350e-44a3-81a0-e649ea409d0e-kube-api-access-sf7r8\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:42:02.252068 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:02.252032    2568 generic.go:356] "Generic (PLEG): container finished" podID="7b108191-350e-44a3-81a0-e649ea409d0e" containerID="11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04" exitCode=0
Aug 03 23:42:02.252068 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:02.252072    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-d6vhv"
Aug 03 23:42:02.252629 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:02.252121    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-d6vhv" event={"ID":"7b108191-350e-44a3-81a0-e649ea409d0e","Type":"ContainerDied","Data":"11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04"}
Aug 03 23:42:02.252629 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:02.252169    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-d6vhv" event={"ID":"7b108191-350e-44a3-81a0-e649ea409d0e","Type":"ContainerDied","Data":"23eb8456dc939e53da6d5c8cfbe0f4264340f7d5dd20ddcf909ae2b3d017b8cb"}
Aug 03 23:42:02.252629 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:02.252192    2568 scope.go:117] "RemoveContainer" containerID="11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04"
Aug 03 23:42:02.260417 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:02.260400    2568 scope.go:117] "RemoveContainer" containerID="11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04"
Aug 03 23:42:02.260753 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:42:02.260735    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04\": container with ID starting with 11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04 not found: ID does not exist" containerID="11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04"
Aug 03 23:42:02.260804 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:02.260764    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04"} err="failed to get container status \"11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04\": rpc error: code = NotFound desc = could not find container \"11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04\": container with ID starting with 11f4b96a22f84c098c58d889aa2d9779ec38d2acbacef970aa5e0e6f3bc54d04 not found: ID does not exist"
Aug 03 23:42:02.269053 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:02.269025    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-d6vhv"]
Aug 03 23:42:02.274323 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:02.274293    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-d6vhv"]
Aug 03 23:42:03.659149 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:03.659113    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b108191-350e-44a3-81a0-e649ea409d0e" path="/var/lib/kubelet/pods/7b108191-350e-44a3-81a0-e649ea409d0e/volumes"
Aug 03 23:42:09.238522 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:09.238480    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"
Aug 03 23:42:11.283446 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:11.283412    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:42:11.386490 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:11.386451    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:42:11.737986 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:11.737934    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:42:23.819549 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:23.819509    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:42:23.975646 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:23.975608    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:42:24.038610 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.038576    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wdrj9"]
Aug 03 23:42:24.038917 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.038905    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b108191-350e-44a3-81a0-e649ea409d0e" containerName="authorino"
Aug 03 23:42:24.038969 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.038919    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b108191-350e-44a3-81a0-e649ea409d0e" containerName="authorino"
Aug 03 23:42:24.039005 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.038977    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b108191-350e-44a3-81a0-e649ea409d0e" containerName="authorino"
Aug 03 23:42:24.041794 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.041772    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wdrj9"
Aug 03 23:42:24.044117 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.044093    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-w24fk\""
Aug 03 23:42:24.045629 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.045608    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wdrj9"]
Aug 03 23:42:24.128982 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.128895    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx8hv\" (UniqueName: \"kubernetes.io/projected/14c45be9-dfd3-4439-9b27-c1ec8769374b-kube-api-access-hx8hv\") pod \"authorino-5dc7ccb5f-wdrj9\" (UID: \"14c45be9-dfd3-4439-9b27-c1ec8769374b\") " pod="kuadrant-system/authorino-5dc7ccb5f-wdrj9"
Aug 03 23:42:24.174385 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.174356    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wdrj9"]
Aug 03 23:42:24.174627 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:42:24.174609    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hx8hv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-wdrj9" podUID="14c45be9-dfd3-4439-9b27-c1ec8769374b"
Aug 03 23:42:24.199420 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.199386    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-g9nbv"]
Aug 03 23:42:24.202590 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.202566    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-g9nbv"
Aug 03 23:42:24.204643 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.204622    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 03 23:42:24.211895 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.211872    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-g9nbv"]
Aug 03 23:42:24.230018 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.229987    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-tls-cert\") pod \"authorino-687bd45585-g9nbv\" (UID: \"fd044a54-c722-43a1-b2c3-45a6e7c4be2d\") " pod="kuadrant-system/authorino-687bd45585-g9nbv"
Aug 03 23:42:24.230018 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.230017    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stvk2\" (UniqueName: \"kubernetes.io/projected/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-kube-api-access-stvk2\") pod \"authorino-687bd45585-g9nbv\" (UID: \"fd044a54-c722-43a1-b2c3-45a6e7c4be2d\") " pod="kuadrant-system/authorino-687bd45585-g9nbv"
Aug 03 23:42:24.230212 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.230053    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx8hv\" (UniqueName: \"kubernetes.io/projected/14c45be9-dfd3-4439-9b27-c1ec8769374b-kube-api-access-hx8hv\") pod \"authorino-5dc7ccb5f-wdrj9\" (UID: \"14c45be9-dfd3-4439-9b27-c1ec8769374b\") " pod="kuadrant-system/authorino-5dc7ccb5f-wdrj9"
Aug 03 23:42:24.238775 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.238748    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx8hv\" (UniqueName: \"kubernetes.io/projected/14c45be9-dfd3-4439-9b27-c1ec8769374b-kube-api-access-hx8hv\") pod \"authorino-5dc7ccb5f-wdrj9\" (UID: \"14c45be9-dfd3-4439-9b27-c1ec8769374b\") " pod="kuadrant-system/authorino-5dc7ccb5f-wdrj9"
Aug 03 23:42:24.269967 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.269928    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-g9nbv"]
Aug 03 23:42:24.270216 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:42:24.270198    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-stvk2 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-g9nbv" podUID="fd044a54-c722-43a1-b2c3-45a6e7c4be2d"
Aug 03 23:42:24.292821 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.292781    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-787d9df9d8-qxcbq"]
Aug 03 23:42:24.296151 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.296126    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787d9df9d8-qxcbq"
Aug 03 23:42:24.304651 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.304626    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-787d9df9d8-qxcbq"]
Aug 03 23:42:24.330750 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.330710    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad18fdbd-c171-45c7-9725-e4a3ad55a421-tls-cert\") pod \"authorino-787d9df9d8-qxcbq\" (UID: \"ad18fdbd-c171-45c7-9725-e4a3ad55a421\") " pod="kuadrant-system/authorino-787d9df9d8-qxcbq"
Aug 03 23:42:24.330905 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.330764    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p9kf\" (UniqueName: \"kubernetes.io/projected/ad18fdbd-c171-45c7-9725-e4a3ad55a421-kube-api-access-8p9kf\") pod \"authorino-787d9df9d8-qxcbq\" (UID: \"ad18fdbd-c171-45c7-9725-e4a3ad55a421\") " pod="kuadrant-system/authorino-787d9df9d8-qxcbq"
Aug 03 23:42:24.330905 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.330880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-tls-cert\") pod \"authorino-687bd45585-g9nbv\" (UID: \"fd044a54-c722-43a1-b2c3-45a6e7c4be2d\") " pod="kuadrant-system/authorino-687bd45585-g9nbv"
Aug 03 23:42:24.330984 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.330909    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stvk2\" (UniqueName: \"kubernetes.io/projected/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-kube-api-access-stvk2\") pod \"authorino-687bd45585-g9nbv\" (UID: \"fd044a54-c722-43a1-b2c3-45a6e7c4be2d\") " pod="kuadrant-system/authorino-687bd45585-g9nbv"
Aug 03 23:42:24.333508 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.333479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-tls-cert\") pod \"authorino-687bd45585-g9nbv\" (UID: \"fd044a54-c722-43a1-b2c3-45a6e7c4be2d\") " pod="kuadrant-system/authorino-687bd45585-g9nbv"
Aug 03 23:42:24.338645 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.338620    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stvk2\" (UniqueName: \"kubernetes.io/projected/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-kube-api-access-stvk2\") pod \"authorino-687bd45585-g9nbv\" (UID: \"fd044a54-c722-43a1-b2c3-45a6e7c4be2d\") " pod="kuadrant-system/authorino-687bd45585-g9nbv"
Aug 03 23:42:24.350167 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.350143    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-g9nbv"
Aug 03 23:42:24.350331 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.350143    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wdrj9"
Aug 03 23:42:24.357413 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.357388    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-g9nbv"
Aug 03 23:42:24.360784 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.360761    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wdrj9"
Aug 03 23:42:24.431313 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.431191    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stvk2\" (UniqueName: \"kubernetes.io/projected/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-kube-api-access-stvk2\") pod \"fd044a54-c722-43a1-b2c3-45a6e7c4be2d\" (UID: \"fd044a54-c722-43a1-b2c3-45a6e7c4be2d\") "
Aug 03 23:42:24.431313 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.431250    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx8hv\" (UniqueName: \"kubernetes.io/projected/14c45be9-dfd3-4439-9b27-c1ec8769374b-kube-api-access-hx8hv\") pod \"14c45be9-dfd3-4439-9b27-c1ec8769374b\" (UID: \"14c45be9-dfd3-4439-9b27-c1ec8769374b\") "
Aug 03 23:42:24.431542 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.431338    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-tls-cert\") pod \"fd044a54-c722-43a1-b2c3-45a6e7c4be2d\" (UID: \"fd044a54-c722-43a1-b2c3-45a6e7c4be2d\") "
Aug 03 23:42:24.431542 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.431412    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad18fdbd-c171-45c7-9725-e4a3ad55a421-tls-cert\") pod \"authorino-787d9df9d8-qxcbq\" (UID: \"ad18fdbd-c171-45c7-9725-e4a3ad55a421\") " pod="kuadrant-system/authorino-787d9df9d8-qxcbq"
Aug 03 23:42:24.431542 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.431450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p9kf\" (UniqueName: \"kubernetes.io/projected/ad18fdbd-c171-45c7-9725-e4a3ad55a421-kube-api-access-8p9kf\") pod \"authorino-787d9df9d8-qxcbq\" (UID: \"ad18fdbd-c171-45c7-9725-e4a3ad55a421\") " pod="kuadrant-system/authorino-787d9df9d8-qxcbq"
Aug 03 23:42:24.433747 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.433701    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14c45be9-dfd3-4439-9b27-c1ec8769374b-kube-api-access-hx8hv" (OuterVolumeSpecName: "kube-api-access-hx8hv") pod "14c45be9-dfd3-4439-9b27-c1ec8769374b" (UID: "14c45be9-dfd3-4439-9b27-c1ec8769374b"). InnerVolumeSpecName "kube-api-access-hx8hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:42:24.433747 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.433741    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-kube-api-access-stvk2" (OuterVolumeSpecName: "kube-api-access-stvk2") pod "fd044a54-c722-43a1-b2c3-45a6e7c4be2d" (UID: "fd044a54-c722-43a1-b2c3-45a6e7c4be2d"). InnerVolumeSpecName "kube-api-access-stvk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:42:24.433943 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.433744    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fd044a54-c722-43a1-b2c3-45a6e7c4be2d" (UID: "fd044a54-c722-43a1-b2c3-45a6e7c4be2d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 03 23:42:24.434056 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.434039    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad18fdbd-c171-45c7-9725-e4a3ad55a421-tls-cert\") pod \"authorino-787d9df9d8-qxcbq\" (UID: \"ad18fdbd-c171-45c7-9725-e4a3ad55a421\") " pod="kuadrant-system/authorino-787d9df9d8-qxcbq"
Aug 03 23:42:24.439158 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.439066    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p9kf\" (UniqueName: \"kubernetes.io/projected/ad18fdbd-c171-45c7-9725-e4a3ad55a421-kube-api-access-8p9kf\") pod \"authorino-787d9df9d8-qxcbq\" (UID: \"ad18fdbd-c171-45c7-9725-e4a3ad55a421\") " pod="kuadrant-system/authorino-787d9df9d8-qxcbq"
Aug 03 23:42:24.532337 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.532299    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx8hv\" (UniqueName: \"kubernetes.io/projected/14c45be9-dfd3-4439-9b27-c1ec8769374b-kube-api-access-hx8hv\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:42:24.532337 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.532330    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-tls-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:42:24.532337 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.532340    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stvk2\" (UniqueName: \"kubernetes.io/projected/fd044a54-c722-43a1-b2c3-45a6e7c4be2d-kube-api-access-stvk2\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:42:24.607072 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.607039    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787d9df9d8-qxcbq"
Aug 03 23:42:24.738123 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:24.738097    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-787d9df9d8-qxcbq"]
Aug 03 23:42:24.740645 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:42:24.740620    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad18fdbd_c171_45c7_9725_e4a3ad55a421.slice/crio-9dc7742c4636a319bc7285004538df99ab0e4fd8e6664da89e0f3fab192020a2 WatchSource:0}: Error finding container 9dc7742c4636a319bc7285004538df99ab0e4fd8e6664da89e0f3fab192020a2: Status 404 returned error can't find the container with id 9dc7742c4636a319bc7285004538df99ab0e4fd8e6664da89e0f3fab192020a2
Aug 03 23:42:25.357362 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.357334    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-wdrj9"
Aug 03 23:42:25.357362 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.357355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787d9df9d8-qxcbq" event={"ID":"ad18fdbd-c171-45c7-9725-e4a3ad55a421","Type":"ContainerStarted","Data":"d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6"}
Aug 03 23:42:25.357775 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.357403    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787d9df9d8-qxcbq" event={"ID":"ad18fdbd-c171-45c7-9725-e4a3ad55a421","Type":"ContainerStarted","Data":"9dc7742c4636a319bc7285004538df99ab0e4fd8e6664da89e0f3fab192020a2"}
Aug 03 23:42:25.357775 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.357438    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-g9nbv"
Aug 03 23:42:25.372286 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.372224    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-787d9df9d8-qxcbq" podStartSLOduration=0.828128882 podStartE2EDuration="1.372207674s" totalImagesPullingTime="544.078792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:42:25.370384566 +0000 UTC m=+746.256713031" watchObservedRunningTime="2026-08-03 23:42:25.372207674 +0000 UTC m=+746.258536139"
Aug 03 23:42:25.395580 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.395552    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-g9nbv"]
Aug 03 23:42:25.404311 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.404279    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-g9nbv"]
Aug 03 23:42:25.430808 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.430441    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wdrj9"]
Aug 03 23:42:25.432815 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.432784    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-wdrj9"]
Aug 03 23:42:25.659520 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.659433    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14c45be9-dfd3-4439-9b27-c1ec8769374b" path="/var/lib/kubelet/pods/14c45be9-dfd3-4439-9b27-c1ec8769374b/volumes"
Aug 03 23:42:25.659777 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:25.659759    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd044a54-c722-43a1-b2c3-45a6e7c4be2d" path="/var/lib/kubelet/pods/fd044a54-c722-43a1-b2c3-45a6e7c4be2d/volumes"
Aug 03 23:42:29.977231 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:29.977168    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:42:30.029887 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:30.029856    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:42:30.442805 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:30.442712    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:42:33.639473 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:33.639441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:42:33.719057 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:42:33.719025    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:03.052332 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:03.052285    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:03.146100 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:03.146063    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:04.598773 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:04.598739    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:04.857255 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:04.857167    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:05.041395 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:05.041358    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:05.148896 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:05.148816    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:05.190677 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:05.190630    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:43:14.784201 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:14.784160    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:14.884155 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:14.884069    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:15.576076 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:15.576041    2568 generic.go:356] "Generic (PLEG): container finished" podID="097c62e4-1209-4de6-83c5-5b6edf3bc128" containerID="86ce7f2f269c6584e685ba2d85ca182b6dd1a46415c14dc312234476541a59aa" exitCode=0
Aug 03 23:43:15.576292 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:15.576086    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" event={"ID":"097c62e4-1209-4de6-83c5-5b6edf3bc128","Type":"ContainerDied","Data":"86ce7f2f269c6584e685ba2d85ca182b6dd1a46415c14dc312234476541a59aa"}
Aug 03 23:43:15.576500 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:15.576475    2568 scope.go:117] "RemoveContainer" containerID="86ce7f2f269c6584e685ba2d85ca182b6dd1a46415c14dc312234476541a59aa"
Aug 03 23:43:15.577456 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:15.577425    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:43:15.577548 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:15.577497    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:43:15.577548 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:15.577526    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 03 23:43:16.582493 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:16.582454    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" event={"ID":"097c62e4-1209-4de6-83c5-5b6edf3bc128","Type":"ContainerStarted","Data":"9dfd681dd917b76dea42ec2c419a4bff4e96b2fa55974d9838554e484af3bc95"}
Aug 03 23:43:16.724464 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:16.724423    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:43:16.724647 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:16.724626    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-mxp6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Aug 03 23:43:16.724727 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:16.724706    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" podUID="097c62e4-1209-4de6-83c5-5b6edf3bc128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Aug 03 23:43:17.725364 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:17.725324    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-mxp6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Aug 03 23:43:17.725757 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:17.725379    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" podUID="097c62e4-1209-4de6-83c5-5b6edf3bc128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Aug 03 23:43:18.724381 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:18.724346    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-mxp6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Aug 03 23:43:18.724570 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:18.724415    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" podUID="097c62e4-1209-4de6-83c5-5b6edf3bc128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Aug 03 23:43:19.724496 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:19.724396    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-mxp6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Aug 03 23:43:19.724496 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:19.724453    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" podUID="097c62e4-1209-4de6-83c5-5b6edf3bc128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Aug 03 23:43:20.724563 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:20.724525    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-mxp6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Aug 03 23:43:20.725043 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:20.724603    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" podUID="097c62e4-1209-4de6-83c5-5b6edf3bc128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Aug 03 23:43:21.724831 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:21.724783    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-mxp6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Aug 03 23:43:21.725340 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:21.724863    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r" podUID="097c62e4-1209-4de6-83c5-5b6edf3bc128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Aug 03 23:43:22.728298 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:22.728250    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:43:22.728742 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:22.728721    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:43:22.729441 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:22.729426    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mxp6r"
Aug 03 23:43:33.368310 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:33.368251    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:33.897427 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:33.897393    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:43:36.445768 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:36.445732    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:36.496712 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:36.496676    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:37.154684 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:37.154643    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:43:41.759929 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:41.759884    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:42.642367 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:42.642315    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:43:51.474240 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:51.474201    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:52.143332 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:52.143289    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:43:55.177299 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:55.177244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:43:56.450839 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:43:56.450805    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:44:13.446031 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.445998    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"]
Aug 03 23:44:13.448655 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.448633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.450903 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.450878    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 03 23:44:13.451980 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.451962    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jsgb6\""
Aug 03 23:44:13.452109 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.452004    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Aug 03 23:44:13.452109 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.452017    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 03 23:44:13.459998 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.459945    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"]
Aug 03 23:44:13.480113 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.480075    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:44:13.490127 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.490087    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.490343 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.490145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzrzk\" (UniqueName: \"kubernetes.io/projected/48da21b6-8905-4e33-9896-7500af2c9f89-kube-api-access-fzrzk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.490343 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.490208    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48da21b6-8905-4e33-9896-7500af2c9f89-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.490343 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.490287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.490343 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.490333    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.490544 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.490416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.591230 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.591193    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48da21b6-8905-4e33-9896-7500af2c9f89-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.591511 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.591254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.591511 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.591330    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.591511 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.591360    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.591511 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.591438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.591511 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.591474    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzrzk\" (UniqueName: \"kubernetes.io/projected/48da21b6-8905-4e33-9896-7500af2c9f89-kube-api-access-fzrzk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.592279 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.592237    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.592486 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.592442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.593593 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.593564    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.593942 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.593923    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48da21b6-8905-4e33-9896-7500af2c9f89-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.594145 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.594117    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48da21b6-8905-4e33-9896-7500af2c9f89-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.600594 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.600552    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzrzk\" (UniqueName: \"kubernetes.io/projected/48da21b6-8905-4e33-9896-7500af2c9f89-kube-api-access-fzrzk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-htrsg\" (UID: \"48da21b6-8905-4e33-9896-7500af2c9f89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.760307 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.760270    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:13.897672 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:13.897568    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"]
Aug 03 23:44:13.900408 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:44:13.900377    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48da21b6_8905_4e33_9896_7500af2c9f89.slice/crio-2194c4bfca9e4a37b014a443d391a0e368c11260cb1eb1eed7140508bb5af109 WatchSource:0}: Error finding container 2194c4bfca9e4a37b014a443d391a0e368c11260cb1eb1eed7140508bb5af109: Status 404 returned error can't find the container with id 2194c4bfca9e4a37b014a443d391a0e368c11260cb1eb1eed7140508bb5af109
Aug 03 23:44:14.849381 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:14.849343    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg" event={"ID":"48da21b6-8905-4e33-9896-7500af2c9f89","Type":"ContainerStarted","Data":"2194c4bfca9e4a37b014a443d391a0e368c11260cb1eb1eed7140508bb5af109"}
Aug 03 23:44:15.855572 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:15.855535    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg" event={"ID":"48da21b6-8905-4e33-9896-7500af2c9f89","Type":"ContainerStarted","Data":"050083f7448549b67507bc3e05a81edd0fca82106dd1bc93b54bdcb634dd6740"}
Aug 03 23:44:15.872710 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:15.872659    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg" podStartSLOduration=1.899277517 podStartE2EDuration="2.87264114s" totalImagesPullingTime="973.363623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:44:15.871348523 +0000 UTC m=+856.757676989" watchObservedRunningTime="2026-08-03 23:44:15.87264114 +0000 UTC m=+856.758969622"
Aug 03 23:44:16.051717 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:16.051686    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:44:23.760934 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:23.760895    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:23.761429 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:23.760953    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:23.773755 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:23.773727    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:23.907675 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:23.907650    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-htrsg"
Aug 03 23:44:45.068645 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:45.068599    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:44:46.217956 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:46.217922    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:44:49.389061 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:44:49.389025    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:45:00.141818 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:00.141782    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6"]
Aug 03 23:45:00.144998 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:00.144979    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6"
Aug 03 23:45:00.147222 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:00.147204    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9x6w2\""
Aug 03 23:45:00.150806 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:00.150778    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6"]
Aug 03 23:45:00.155807 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:00.155786    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6"
Aug 03 23:45:00.294687 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:00.294650    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6"]
Aug 03 23:45:00.297694 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:45:00.297664    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086f785e_7eac_4e57_91be_1a029e3d61a0.slice/crio-450127f0c15c15e24d7aa5c7cb1b827bbe2307a321461374fdcd7a66511747ab WatchSource:0}: Error finding container 450127f0c15c15e24d7aa5c7cb1b827bbe2307a321461374fdcd7a66511747ab: Status 404 returned error can't find the container with id 450127f0c15c15e24d7aa5c7cb1b827bbe2307a321461374fdcd7a66511747ab
Aug 03 23:45:01.064760 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:01.064725    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6" event={"ID":"086f785e-7eac-4e57-91be-1a029e3d61a0","Type":"ContainerStarted","Data":"450127f0c15c15e24d7aa5c7cb1b827bbe2307a321461374fdcd7a66511747ab"}
Aug 03 23:45:03.076570 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:03.076530    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6" event={"ID":"086f785e-7eac-4e57-91be-1a029e3d61a0","Type":"ContainerStarted","Data":"aa9261f0a52db96e56300e2ba11bf999767463e090d8516d730037e0e52c02d9"}
Aug 03 23:45:03.092374 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:03.092307    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6" podStartSLOduration=0.751077683 podStartE2EDuration="3.092288525s" totalImagesPullingTime="2.341210842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:45:03.090217688 +0000 UTC m=+903.976546153" watchObservedRunningTime="2026-08-03 23:45:03.092288525 +0000 UTC m=+903.978616991"
Aug 03 23:45:04.082511 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:04.082472    2568 generic.go:356] "Generic (PLEG): container finished" podID="086f785e-7eac-4e57-91be-1a029e3d61a0" containerID="aa9261f0a52db96e56300e2ba11bf999767463e090d8516d730037e0e52c02d9" exitCode=0
Aug 03 23:45:04.082892 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:04.082530    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6" event={"ID":"086f785e-7eac-4e57-91be-1a029e3d61a0","Type":"ContainerDied","Data":"aa9261f0a52db96e56300e2ba11bf999767463e090d8516d730037e0e52c02d9"}
Aug 03 23:45:05.220547 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:05.220524    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6"
Aug 03 23:45:06.093932 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:06.093901    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6"
Aug 03 23:45:06.093932 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:06.093921    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6" event={"ID":"086f785e-7eac-4e57-91be-1a029e3d61a0","Type":"ContainerDied","Data":"450127f0c15c15e24d7aa5c7cb1b827bbe2307a321461374fdcd7a66511747ab"}
Aug 03 23:45:06.094192 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:06.093993    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="450127f0c15c15e24d7aa5c7cb1b827bbe2307a321461374fdcd7a66511747ab"
Aug 03 23:45:07.862975 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:07.862942    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:45:23.907987 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:23.907953    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fd9f45b89-bbb62"]
Aug 03 23:45:23.908480 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:23.908294    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086f785e-7eac-4e57-91be-1a029e3d61a0" containerName="cleanup"
Aug 03 23:45:23.908480 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:23.908307    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="086f785e-7eac-4e57-91be-1a029e3d61a0" containerName="cleanup"
Aug 03 23:45:23.908480 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:23.908357    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="086f785e-7eac-4e57-91be-1a029e3d61a0" containerName="cleanup"
Aug 03 23:45:23.911187 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:23.911171    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fd9f45b89-bbb62"
Aug 03 23:45:23.920285 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:23.920244    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fd9f45b89-bbb62"]
Aug 03 23:45:24.027431 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:24.027394    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b76cf502-aaba-43cf-8402-219e07de6521-tls-cert\") pod \"authorino-6fd9f45b89-bbb62\" (UID: \"b76cf502-aaba-43cf-8402-219e07de6521\") " pod="kuadrant-system/authorino-6fd9f45b89-bbb62"
Aug 03 23:45:24.027610 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:24.027463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbb7h\" (UniqueName: \"kubernetes.io/projected/b76cf502-aaba-43cf-8402-219e07de6521-kube-api-access-mbb7h\") pod \"authorino-6fd9f45b89-bbb62\" (UID: \"b76cf502-aaba-43cf-8402-219e07de6521\") " pod="kuadrant-system/authorino-6fd9f45b89-bbb62"
Aug 03 23:45:24.127944 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:24.127907    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b76cf502-aaba-43cf-8402-219e07de6521-tls-cert\") pod \"authorino-6fd9f45b89-bbb62\" (UID: \"b76cf502-aaba-43cf-8402-219e07de6521\") " pod="kuadrant-system/authorino-6fd9f45b89-bbb62"
Aug 03 23:45:24.128106 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:24.127981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbb7h\" (UniqueName: \"kubernetes.io/projected/b76cf502-aaba-43cf-8402-219e07de6521-kube-api-access-mbb7h\") pod \"authorino-6fd9f45b89-bbb62\" (UID: \"b76cf502-aaba-43cf-8402-219e07de6521\") " pod="kuadrant-system/authorino-6fd9f45b89-bbb62"
Aug 03 23:45:24.130658 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:24.130631    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b76cf502-aaba-43cf-8402-219e07de6521-tls-cert\") pod \"authorino-6fd9f45b89-bbb62\" (UID: \"b76cf502-aaba-43cf-8402-219e07de6521\") " pod="kuadrant-system/authorino-6fd9f45b89-bbb62"
Aug 03 23:45:24.135612 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:24.135592    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbb7h\" (UniqueName: \"kubernetes.io/projected/b76cf502-aaba-43cf-8402-219e07de6521-kube-api-access-mbb7h\") pod \"authorino-6fd9f45b89-bbb62\" (UID: \"b76cf502-aaba-43cf-8402-219e07de6521\") " pod="kuadrant-system/authorino-6fd9f45b89-bbb62"
Aug 03 23:45:24.221651 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:24.221616    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fd9f45b89-bbb62"
Aug 03 23:45:24.358666 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:24.358521    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fd9f45b89-bbb62"]
Aug 03 23:45:24.361330 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:45:24.361302    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb76cf502_aaba_43cf_8402_219e07de6521.slice/crio-5347ecd547c8d2ebdb9d9e1d438ecf65ce4e160b327d8d500b2ffc7397b163d7 WatchSource:0}: Error finding container 5347ecd547c8d2ebdb9d9e1d438ecf65ce4e160b327d8d500b2ffc7397b163d7: Status 404 returned error can't find the container with id 5347ecd547c8d2ebdb9d9e1d438ecf65ce4e160b327d8d500b2ffc7397b163d7
Aug 03 23:45:25.183768 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:25.183733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fd9f45b89-bbb62" event={"ID":"b76cf502-aaba-43cf-8402-219e07de6521","Type":"ContainerStarted","Data":"5347ecd547c8d2ebdb9d9e1d438ecf65ce4e160b327d8d500b2ffc7397b163d7"}
Aug 03 23:45:26.190705 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.190665    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fd9f45b89-bbb62" event={"ID":"b76cf502-aaba-43cf-8402-219e07de6521","Type":"ContainerStarted","Data":"7a45681ef40456c7c9b21f75f8afcf21a194018167e70f6cacce1b8ef150d274"}
Aug 03 23:45:26.206507 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.206447    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6fd9f45b89-bbb62" podStartSLOduration=2.354713866 podStartE2EDuration="3.206427453s" totalImagesPullingTime="851.713587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:45:26.20549346 +0000 UTC m=+927.091821926" watchObservedRunningTime="2026-08-03 23:45:26.206427453 +0000 UTC m=+927.092755917"
Aug 03 23:45:26.232026 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.231987    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-787d9df9d8-qxcbq"]
Aug 03 23:45:26.232238 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.232206    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-787d9df9d8-qxcbq" podUID="ad18fdbd-c171-45c7-9725-e4a3ad55a421" containerName="authorino" containerID="cri-o://d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6" gracePeriod=30
Aug 03 23:45:26.499804 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.499772    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787d9df9d8-qxcbq"
Aug 03 23:45:26.652676 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.652638    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad18fdbd-c171-45c7-9725-e4a3ad55a421-tls-cert\") pod \"ad18fdbd-c171-45c7-9725-e4a3ad55a421\" (UID: \"ad18fdbd-c171-45c7-9725-e4a3ad55a421\") "
Aug 03 23:45:26.652873 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.652715    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p9kf\" (UniqueName: \"kubernetes.io/projected/ad18fdbd-c171-45c7-9725-e4a3ad55a421-kube-api-access-8p9kf\") pod \"ad18fdbd-c171-45c7-9725-e4a3ad55a421\" (UID: \"ad18fdbd-c171-45c7-9725-e4a3ad55a421\") "
Aug 03 23:45:26.654787 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.654750    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad18fdbd-c171-45c7-9725-e4a3ad55a421-kube-api-access-8p9kf" (OuterVolumeSpecName: "kube-api-access-8p9kf") pod "ad18fdbd-c171-45c7-9725-e4a3ad55a421" (UID: "ad18fdbd-c171-45c7-9725-e4a3ad55a421"). InnerVolumeSpecName "kube-api-access-8p9kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:45:26.664234 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.664189    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad18fdbd-c171-45c7-9725-e4a3ad55a421-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ad18fdbd-c171-45c7-9725-e4a3ad55a421" (UID: "ad18fdbd-c171-45c7-9725-e4a3ad55a421"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 03 23:45:26.722238 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.722195    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:45:26.754335 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.754219    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad18fdbd-c171-45c7-9725-e4a3ad55a421-tls-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:45:26.754335 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.754278    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p9kf\" (UniqueName: \"kubernetes.io/projected/ad18fdbd-c171-45c7-9725-e4a3ad55a421-kube-api-access-8p9kf\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:45:26.820377 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:26.820341    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:45:27.196776 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.196682    2568 generic.go:356] "Generic (PLEG): container finished" podID="ad18fdbd-c171-45c7-9725-e4a3ad55a421" containerID="d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6" exitCode=0
Aug 03 23:45:27.196776 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.196736    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787d9df9d8-qxcbq"
Aug 03 23:45:27.197239 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.196772    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787d9df9d8-qxcbq" event={"ID":"ad18fdbd-c171-45c7-9725-e4a3ad55a421","Type":"ContainerDied","Data":"d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6"}
Aug 03 23:45:27.197239 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.196821    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787d9df9d8-qxcbq" event={"ID":"ad18fdbd-c171-45c7-9725-e4a3ad55a421","Type":"ContainerDied","Data":"9dc7742c4636a319bc7285004538df99ab0e4fd8e6664da89e0f3fab192020a2"}
Aug 03 23:45:27.197239 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.196845    2568 scope.go:117] "RemoveContainer" containerID="d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6"
Aug 03 23:45:27.207761 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.207739    2568 scope.go:117] "RemoveContainer" containerID="d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6"
Aug 03 23:45:27.208113 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:45:27.208084    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6\": container with ID starting with d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6 not found: ID does not exist" containerID="d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6"
Aug 03 23:45:27.208229 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.208129    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6"} err="failed to get container status \"d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6\": rpc error: code = NotFound desc = could not find container \"d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6\": container with ID starting with d01b6b0ac361a5ee8b4c4a393d4bb8a421676ce05dd6496287b0448c7c152fe6 not found: ID does not exist"
Aug 03 23:45:27.217785 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.217756    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-787d9df9d8-qxcbq"]
Aug 03 23:45:27.222166 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.222139    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-787d9df9d8-qxcbq"]
Aug 03 23:45:27.662137 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.662099    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad18fdbd-c171-45c7-9725-e4a3ad55a421" path="/var/lib/kubelet/pods/ad18fdbd-c171-45c7-9725-e4a3ad55a421/volumes"
Aug 03 23:45:27.773240 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.773206    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:45:27.873376 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:27.873335    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:45:53.782746 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:45:53.782706    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:46:03.749787 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:46:03.749749    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:46:16.116482 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:46:16.116451    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:46:17.143479 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:46:17.143447    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:46:35.511698 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:46:35.511611    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:46:35.612489 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:46:35.612448    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:46:58.531417 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:46:58.531381    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:47:31.493237 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:47:31.493207    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:47:32.690535 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:47:32.690496    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:47:48.113551 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:47:48.113510    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:47:52.319935 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:47:52.319830    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:48:00.748298 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:00.748248    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:48:28.911497 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:28.911458    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:48:29.012769 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:29.012735    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:48:29.115959 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:29.115913    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:48:35.117806 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:35.117773    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:48:35.220092 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:35.220052    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:48:35.322335 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:35.322304    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:48:35.442585 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:35.442493    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:48:41.360395 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:41.360354    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:48:41.461728 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:41.461688    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:48:56.440959 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:48:56.440927    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:49:04.542172 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:49:04.542135    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:49:19.441125 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:49:19.441086    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:49:25.447937 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:49:25.447903    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:49:35.045892 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:49:35.045857    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:49:41.553153 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:49:41.553112    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:49:55.445812 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:49:55.445775    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:50:00.743952 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:50:00.743913    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:50:08.739563 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:50:08.739525    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:50:14.551060 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:50:14.551027    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:50:28.050651 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:50:28.050608    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:50:38.045156 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:50:38.045118    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:51:00.149381 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:51:00.149292    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:51:10.445345 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:51:10.445306    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:51:15.447808 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:51:15.447773    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:51:23.343227 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:51:23.343188    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:51:31.344765 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:51:31.344730    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:51:36.244807 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:51:36.244765    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:51:41.341243 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:51:41.341209    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:51:48.945188 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:51:48.945144    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:52:00.642849 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:52:00.642805    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:52:07.551283 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:52:07.548072    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:52:18.741718 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:52:18.741681    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:52:24.040210 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:52:24.040121    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:52:30.645817 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:52:30.645776    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:52:39.040494 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:52:39.040459    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:52:44.040182 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:52:44.040143    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:52:54.651406 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:52:54.651366    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:53:12.908121 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:12.908079    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:53:38.542621 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:38.542584    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:53:49.685603 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:49.685520    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"]
Aug 03 23:53:49.686126 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:49.685728    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj" podUID="ed590a2a-c05f-4ff9-a349-6f9145773e8a" containerName="manager" containerID="cri-o://1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403" gracePeriod=10
Aug 03 23:53:49.946517 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:49.946447    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:53:50.109707 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.109673    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed590a2a-c05f-4ff9-a349-6f9145773e8a-extensions-socket-volume\") pod \"ed590a2a-c05f-4ff9-a349-6f9145773e8a\" (UID: \"ed590a2a-c05f-4ff9-a349-6f9145773e8a\") "
Aug 03 23:53:50.109894 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.109763    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjjf8\" (UniqueName: \"kubernetes.io/projected/ed590a2a-c05f-4ff9-a349-6f9145773e8a-kube-api-access-fjjf8\") pod \"ed590a2a-c05f-4ff9-a349-6f9145773e8a\" (UID: \"ed590a2a-c05f-4ff9-a349-6f9145773e8a\") "
Aug 03 23:53:50.110031 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.109998    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed590a2a-c05f-4ff9-a349-6f9145773e8a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed590a2a-c05f-4ff9-a349-6f9145773e8a" (UID: "ed590a2a-c05f-4ff9-a349-6f9145773e8a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:53:50.112030 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.112008    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed590a2a-c05f-4ff9-a349-6f9145773e8a-kube-api-access-fjjf8" (OuterVolumeSpecName: "kube-api-access-fjjf8") pod "ed590a2a-c05f-4ff9-a349-6f9145773e8a" (UID: "ed590a2a-c05f-4ff9-a349-6f9145773e8a"). InnerVolumeSpecName "kube-api-access-fjjf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:53:50.211514 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.211431    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed590a2a-c05f-4ff9-a349-6f9145773e8a-extensions-socket-volume\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:53:50.211514 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.211458    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjjf8\" (UniqueName: \"kubernetes.io/projected/ed590a2a-c05f-4ff9-a349-6f9145773e8a-kube-api-access-fjjf8\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:53:50.553039 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.553003    2568 generic.go:356] "Generic (PLEG): container finished" podID="ed590a2a-c05f-4ff9-a349-6f9145773e8a" containerID="1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403" exitCode=0
Aug 03 23:53:50.553219 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.553057    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"
Aug 03 23:53:50.553219 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.553082    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj" event={"ID":"ed590a2a-c05f-4ff9-a349-6f9145773e8a","Type":"ContainerDied","Data":"1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403"}
Aug 03 23:53:50.553219 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.553170    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj" event={"ID":"ed590a2a-c05f-4ff9-a349-6f9145773e8a","Type":"ContainerDied","Data":"def1e4bd895da8140d04b1be86395446ca0727dc099015ee85837c07b4b00f6a"}
Aug 03 23:53:50.553219 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.553199    2568 scope.go:117] "RemoveContainer" containerID="1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403"
Aug 03 23:53:50.563633 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.563617    2568 scope.go:117] "RemoveContainer" containerID="1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403"
Aug 03 23:53:50.563932 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:53:50.563912    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403\": container with ID starting with 1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403 not found: ID does not exist" containerID="1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403"
Aug 03 23:53:50.564005 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.563940    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403"} err="failed to get container status \"1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403\": rpc error: code = NotFound desc = could not find container \"1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403\": container with ID starting with 1697ba13b58d9260141a465421f7fe0c0e7282beb13f785ab0c90e5ba1b93403 not found: ID does not exist"
Aug 03 23:53:50.575039 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.575016    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"]
Aug 03 23:53:50.577892 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:50.577870    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s8hbj"]
Aug 03 23:53:51.660618 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:53:51.660583    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed590a2a-c05f-4ff9-a349-6f9145773e8a" path="/var/lib/kubelet/pods/ed590a2a-c05f-4ff9-a349-6f9145773e8a/volumes"
Aug 03 23:54:21.281307 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:21.281250    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:54:21.332442 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:21.332402    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:54:50.367725 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.367686    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"]
Aug 03 23:54:50.368124 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.368074    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad18fdbd-c171-45c7-9725-e4a3ad55a421" containerName="authorino"
Aug 03 23:54:50.368124 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.368086    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad18fdbd-c171-45c7-9725-e4a3ad55a421" containerName="authorino"
Aug 03 23:54:50.368124 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.368102    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed590a2a-c05f-4ff9-a349-6f9145773e8a" containerName="manager"
Aug 03 23:54:50.368124 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.368107    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed590a2a-c05f-4ff9-a349-6f9145773e8a" containerName="manager"
Aug 03 23:54:50.368253 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.368163    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed590a2a-c05f-4ff9-a349-6f9145773e8a" containerName="manager"
Aug 03 23:54:50.368253 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.368170    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad18fdbd-c171-45c7-9725-e4a3ad55a421" containerName="authorino"
Aug 03 23:54:50.374829 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.374796    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 03 23:54:50.377654 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.377617    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-q9ssh\""
Aug 03 23:54:50.382531 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.382504    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"]
Aug 03 23:54:50.529741 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.529700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-mv84k\" (UID: \"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 03 23:54:50.529909 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.529763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddffs\" (UniqueName: \"kubernetes.io/projected/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-kube-api-access-ddffs\") pod \"kuadrant-operator-controller-manager-68cf589589-mv84k\" (UID: \"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 03 23:54:50.631034 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.630939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-mv84k\" (UID: \"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 03 23:54:50.631034 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.631000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddffs\" (UniqueName: \"kubernetes.io/projected/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-kube-api-access-ddffs\") pod \"kuadrant-operator-controller-manager-68cf589589-mv84k\" (UID: \"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 03 23:54:50.631398 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.631374    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-mv84k\" (UID: \"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 03 23:54:50.639679 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.639649    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddffs\" (UniqueName: \"kubernetes.io/projected/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-kube-api-access-ddffs\") pod \"kuadrant-operator-controller-manager-68cf589589-mv84k\" (UID: \"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 03 23:54:50.686398 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.686364    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 03 23:54:50.827724 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:50.827694    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"]
Aug 03 23:54:50.831618 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:54:50.831586    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2957e8_5ffe_4e05_bc55_a7ce1b5ad496.slice/crio-48fda02627804bbd461f5fc55f3dcf0050ca16165ef92427416b5f8f2b423f76 WatchSource:0}: Error finding container 48fda02627804bbd461f5fc55f3dcf0050ca16165ef92427416b5f8f2b423f76: Status 404 returned error can't find the container with id 48fda02627804bbd461f5fc55f3dcf0050ca16165ef92427416b5f8f2b423f76
Aug 03 23:54:51.828310 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:51.828252    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k" event={"ID":"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496","Type":"ContainerStarted","Data":"df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033"}
Aug 03 23:54:51.828720 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:51.828328    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k" event={"ID":"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496","Type":"ContainerStarted","Data":"48fda02627804bbd461f5fc55f3dcf0050ca16165ef92427416b5f8f2b423f76"}
Aug 03 23:54:51.828720 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:51.828490    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 03 23:54:51.850686 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:54:51.850635    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k" podStartSLOduration=1.850618478 podStartE2EDuration="1.850618478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:54:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:54:51.847920706 +0000 UTC m=+1492.734249171" watchObservedRunningTime="2026-08-03 23:54:51.850618478 +0000 UTC m=+1492.736946942"
Aug 03 23:55:02.835123 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:55:02.835091    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 03 23:55:09.250757 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:55:09.250720    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:55:14.240083 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:55:14.240045    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:55:39.750091 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:55:39.750005    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:56:19.642455 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:56:19.642416    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:56:26.855386 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:56:26.855349    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:56:34.735225 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:56:34.735190    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:56:39.846495 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:56:39.846458    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:56:50.046081 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:56:50.045998    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:56:56.253738 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:56:56.253699    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:57:05.439181 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:57:05.439141    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:57:10.548939 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:57:10.548901    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:57:20.336994 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:57:20.336957    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:57:26.754743 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:57:26.754707    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:57:35.438803 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:57:35.438765    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:57:42.735122 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:57:42.735082    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:58:00.451087 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:00.451049    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:58:05.851005 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:05.850966    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:58:12.445652 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.445612    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"]
Aug 03 23:58:12.448986 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.448965    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.451109 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.451092    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-0da22152-kserve-self-signed-certs\""
Aug 03 23:58:12.460881 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.460856    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"]
Aug 03 23:58:12.472245 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.472216    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:58:12.623291 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.623222    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-999v9\" (UniqueName: \"kubernetes.io/projected/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-kube-api-access-999v9\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.623493 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.623298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tmp-dir\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.623493 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.623344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-model-cache\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.623493 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.623411    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-home\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.623493 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.623439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-dshm\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.623493 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.623482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tls-certs\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.724443 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.724406    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-home\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.724608 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.724451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-dshm\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.724608 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.724559    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tls-certs\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.724608 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.724595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999v9\" (UniqueName: \"kubernetes.io/projected/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-kube-api-access-999v9\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.724840 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.724629    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tmp-dir\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.724840 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.724688    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-model-cache\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.724840 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.724801    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-home\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.725032 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.724993    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tmp-dir\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.725032 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.725002    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-model-cache\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.726827 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.726798    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-dshm\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.727384 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.727364    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tls-certs\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.732104 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.732079    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-999v9\" (UniqueName: \"kubernetes.io/projected/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-kube-api-access-999v9\") pod \"e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") " pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.758024 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.757989    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:12.898566 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:12.898531    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"]
Aug 03 23:58:12.901445 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:58:12.901418    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b60af8d_4ea1_40d3_82f0_037e6d7c9467.slice/crio-db121450be14d147cb392ae5dc75aa2829307551d2376321b790fbf4c212e3de WatchSource:0}: Error finding container db121450be14d147cb392ae5dc75aa2829307551d2376321b790fbf4c212e3de: Status 404 returned error can't find the container with id db121450be14d147cb392ae5dc75aa2829307551d2376321b790fbf4c212e3de
Aug 03 23:58:13.783547 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:13.783504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5" event={"ID":"6b60af8d-4ea1-40d3-82f0-037e6d7c9467","Type":"ContainerStarted","Data":"1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256"}
Aug 03 23:58:13.783547 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:13.783555    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5" event={"ID":"6b60af8d-4ea1-40d3-82f0-037e6d7c9467","Type":"ContainerStarted","Data":"db121450be14d147cb392ae5dc75aa2829307551d2376321b790fbf4c212e3de"}
Aug 03 23:58:13.800543 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:13.800495    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5" podStartSLOduration=1.8004803090000001 podStartE2EDuration="1.800480309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:58:13.798696907 +0000 UTC m=+1694.685025374" watchObservedRunningTime="2026-08-03 23:58:13.800480309 +0000 UTC m=+1694.686808775"
Aug 03 23:58:14.946440 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:14.946398    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:58:22.758455 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:22.758421    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:22.758949 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:22.758490    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:22.770661 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:22.770632    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:22.841111 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:22.841082    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:58:31.545037 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.544995    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"]
Aug 03 23:58:31.548476 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.548452    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.550879 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.550857    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-0da22152-kserve-self-signed-certs\""
Aug 03 23:58:31.560111 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.560085    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"]
Aug 03 23:58:31.575830 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.575805    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-dshm\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.575960 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.575836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-model-cache\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.575960 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.575880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfd7dcea-e752-445b-8944-954c17642658-tls-certs\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.575960 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.575904    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j74r\" (UniqueName: \"kubernetes.io/projected/bfd7dcea-e752-445b-8944-954c17642658-kube-api-access-4j74r\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.575960 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.575928    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-home\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.575960 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.575946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-tmp-dir\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.581617 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.581589    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:58:31.677098 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.677064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-dshm\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.677098 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.677094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-model-cache\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.677365 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.677131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfd7dcea-e752-445b-8944-954c17642658-tls-certs\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.677365 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.677148    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j74r\" (UniqueName: \"kubernetes.io/projected/bfd7dcea-e752-445b-8944-954c17642658-kube-api-access-4j74r\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.677365 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.677171    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-home\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.677365 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.677190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-tmp-dir\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.677586 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.677553    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-model-cache\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.677586 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.677572    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-tmp-dir\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.677691 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.677596    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-home\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.679538 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.679486    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-dshm\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.679805 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.679756    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfd7dcea-e752-445b-8944-954c17642658-tls-certs\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.685206 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.685182    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j74r\" (UniqueName: \"kubernetes.io/projected/bfd7dcea-e752-445b-8944-954c17642658-kube-api-access-4j74r\") pod \"e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") " pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.858444 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.858349    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:31.997606 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:31.997576    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"]
Aug 03 23:58:32.000026 ip-10-0-138-58 kubenswrapper[2568]: W0803 23:58:31.999996    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfd7dcea_e752_445b_8944_954c17642658.slice/crio-c5dfde8ac9e90e7699c788efadaf1207f79f5c7007dbf778bc76424a76ccb66d WatchSource:0}: Error finding container c5dfde8ac9e90e7699c788efadaf1207f79f5c7007dbf778bc76424a76ccb66d: Status 404 returned error can't find the container with id c5dfde8ac9e90e7699c788efadaf1207f79f5c7007dbf778bc76424a76ccb66d
Aug 03 23:58:32.877915 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:32.877868    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n" event={"ID":"bfd7dcea-e752-445b-8944-954c17642658","Type":"ContainerStarted","Data":"1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e"}
Aug 03 23:58:32.878408 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:32.877933    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n" event={"ID":"bfd7dcea-e752-445b-8944-954c17642658","Type":"ContainerStarted","Data":"c5dfde8ac9e90e7699c788efadaf1207f79f5c7007dbf778bc76424a76ccb66d"}
Aug 03 23:58:32.893583 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:32.893521    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n" podStartSLOduration=1.893498812 podStartE2EDuration="1.893498812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-03 23:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-03 23:58:32.892089021 +0000 UTC m=+1713.778417479" watchObservedRunningTime="2026-08-03 23:58:32.893498812 +0000 UTC m=+1713.779827277"
Aug 03 23:58:34.144365 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:34.144329    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:58:41.859612 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:41.859566    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:41.862158 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:41.859639    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:41.872154 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:41.872130    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:58:41.936984 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:58:41.936955    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:59:00.275509 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:00.275468    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"]
Aug 03 23:59:00.294091 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:00.294043    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:59:01.824604 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:01.824564    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"]
Aug 03 23:59:01.844240 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:01.844208    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 03 23:59:02.242287 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:02.242235    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:59:14.347091 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:14.347049    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:59:15.297027 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.296954    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5" podUID="6b60af8d-4ea1-40d3-82f0-037e6d7c9467" containerName="main" containerID="cri-o://1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256" gracePeriod=45
Aug 03 23:59:15.550211 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.550153    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:59:15.584104 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584071    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tmp-dir\") pod \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") "
Aug 03 23:59:15.584256 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584125    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-home\") pod \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") "
Aug 03 23:59:15.584256 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584168    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-999v9\" (UniqueName: \"kubernetes.io/projected/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-kube-api-access-999v9\") pod \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") "
Aug 03 23:59:15.584256 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584183    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-dshm\") pod \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") "
Aug 03 23:59:15.584256 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584221    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tls-certs\") pod \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") "
Aug 03 23:59:15.584256 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584250    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-model-cache\") pod \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\" (UID: \"6b60af8d-4ea1-40d3-82f0-037e6d7c9467\") "
Aug 03 23:59:15.584558 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584385    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6b60af8d-4ea1-40d3-82f0-037e6d7c9467" (UID: "6b60af8d-4ea1-40d3-82f0-037e6d7c9467"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:59:15.584558 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584463    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-home" (OuterVolumeSpecName: "home") pod "6b60af8d-4ea1-40d3-82f0-037e6d7c9467" (UID: "6b60af8d-4ea1-40d3-82f0-037e6d7c9467"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:59:15.584666 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584593    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tmp-dir\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:15.584666 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584613    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-home\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:15.584666 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.584618    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-model-cache" (OuterVolumeSpecName: "model-cache") pod "6b60af8d-4ea1-40d3-82f0-037e6d7c9467" (UID: "6b60af8d-4ea1-40d3-82f0-037e6d7c9467"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:59:15.586630 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.586604    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-dshm" (OuterVolumeSpecName: "dshm") pod "6b60af8d-4ea1-40d3-82f0-037e6d7c9467" (UID: "6b60af8d-4ea1-40d3-82f0-037e6d7c9467"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:59:15.586734 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.586656    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6b60af8d-4ea1-40d3-82f0-037e6d7c9467" (UID: "6b60af8d-4ea1-40d3-82f0-037e6d7c9467"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 03 23:59:15.586734 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.586671    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-kube-api-access-999v9" (OuterVolumeSpecName: "kube-api-access-999v9") pod "6b60af8d-4ea1-40d3-82f0-037e6d7c9467" (UID: "6b60af8d-4ea1-40d3-82f0-037e6d7c9467"). InnerVolumeSpecName "kube-api-access-999v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:59:15.685912 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.685879    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-999v9\" (UniqueName: \"kubernetes.io/projected/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-kube-api-access-999v9\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:15.685912 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.685909    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-dshm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:15.686080 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.685919    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-tls-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:15.686080 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:15.685928    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b60af8d-4ea1-40d3-82f0-037e6d7c9467-model-cache\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:16.088186 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:16.088151    2568 generic.go:356] "Generic (PLEG): container finished" podID="6b60af8d-4ea1-40d3-82f0-037e6d7c9467" containerID="1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256" exitCode=0
Aug 03 23:59:16.088391 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:16.088204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5" event={"ID":"6b60af8d-4ea1-40d3-82f0-037e6d7c9467","Type":"ContainerDied","Data":"1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256"}
Aug 03 23:59:16.088391 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:16.088215    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"
Aug 03 23:59:16.088391 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:16.088244    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5" event={"ID":"6b60af8d-4ea1-40d3-82f0-037e6d7c9467","Type":"ContainerDied","Data":"db121450be14d147cb392ae5dc75aa2829307551d2376321b790fbf4c212e3de"}
Aug 03 23:59:16.088391 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:16.088291    2568 scope.go:117] "RemoveContainer" containerID="1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256"
Aug 03 23:59:16.096838 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:16.096818    2568 scope.go:117] "RemoveContainer" containerID="1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256"
Aug 03 23:59:16.097107 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:59:16.097085    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256\": container with ID starting with 1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256 not found: ID does not exist" containerID="1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256"
Aug 03 23:59:16.097154 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:16.097120    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256"} err="failed to get container status \"1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256\": rpc error: code = NotFound desc = could not find container \"1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256\": container with ID starting with 1b9727fe8623868ba2059ff95c7273f236190c6c2ea1f0a06bdc62a2f8ea1256 not found: ID does not exist"
Aug 03 23:59:16.104188 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:16.104163    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"]
Aug 03 23:59:16.107777 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:16.107755    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-0da22152-kserve-648b4ff7cf-s6tr5"]
Aug 03 23:59:16.844380 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:16.844331    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n" podUID="bfd7dcea-e752-445b-8944-954c17642658" containerName="main" containerID="cri-o://1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e" gracePeriod=45
Aug 03 23:59:17.092519 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.092495    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:59:17.095721 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.095638    2568 generic.go:356] "Generic (PLEG): container finished" podID="bfd7dcea-e752-445b-8944-954c17642658" containerID="1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e" exitCode=0
Aug 03 23:59:17.095721 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.095676    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"
Aug 03 23:59:17.095721 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.095687    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n" event={"ID":"bfd7dcea-e752-445b-8944-954c17642658","Type":"ContainerDied","Data":"1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e"}
Aug 03 23:59:17.095946 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.095732    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n" event={"ID":"bfd7dcea-e752-445b-8944-954c17642658","Type":"ContainerDied","Data":"c5dfde8ac9e90e7699c788efadaf1207f79f5c7007dbf778bc76424a76ccb66d"}
Aug 03 23:59:17.095946 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.095753    2568 scope.go:117] "RemoveContainer" containerID="1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e"
Aug 03 23:59:17.104037 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.104019    2568 scope.go:117] "RemoveContainer" containerID="1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e"
Aug 03 23:59:17.104303 ip-10-0-138-58 kubenswrapper[2568]: E0803 23:59:17.104256    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e\": container with ID starting with 1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e not found: ID does not exist" containerID="1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e"
Aug 03 23:59:17.104422 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.104316    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e"} err="failed to get container status \"1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e\": rpc error: code = NotFound desc = could not find container \"1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e\": container with ID starting with 1cf6d753e28cc9d8991aafc942907c8ea90f62cb78759df0963b21053fc0261e not found: ID does not exist"
Aug 03 23:59:17.198677 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.198638    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j74r\" (UniqueName: \"kubernetes.io/projected/bfd7dcea-e752-445b-8944-954c17642658-kube-api-access-4j74r\") pod \"bfd7dcea-e752-445b-8944-954c17642658\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") "
Aug 03 23:59:17.198869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.198686    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-model-cache\") pod \"bfd7dcea-e752-445b-8944-954c17642658\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") "
Aug 03 23:59:17.198869 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.198736    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-home\") pod \"bfd7dcea-e752-445b-8944-954c17642658\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") "
Aug 03 23:59:17.198991 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.198872    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-dshm\") pod \"bfd7dcea-e752-445b-8944-954c17642658\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") "
Aug 03 23:59:17.198991 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.198920    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-tmp-dir\") pod \"bfd7dcea-e752-445b-8944-954c17642658\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") "
Aug 03 23:59:17.198991 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.198969    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfd7dcea-e752-445b-8944-954c17642658-tls-certs\") pod \"bfd7dcea-e752-445b-8944-954c17642658\" (UID: \"bfd7dcea-e752-445b-8944-954c17642658\") "
Aug 03 23:59:17.199161 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.198972    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-model-cache" (OuterVolumeSpecName: "model-cache") pod "bfd7dcea-e752-445b-8944-954c17642658" (UID: "bfd7dcea-e752-445b-8944-954c17642658"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:59:17.199161 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.198984    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-home" (OuterVolumeSpecName: "home") pod "bfd7dcea-e752-445b-8944-954c17642658" (UID: "bfd7dcea-e752-445b-8944-954c17642658"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:59:17.199281 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.199162    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bfd7dcea-e752-445b-8944-954c17642658" (UID: "bfd7dcea-e752-445b-8944-954c17642658"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:59:17.199281 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.199244    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-model-cache\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:17.199281 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.199276    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-home\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:17.199607 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.199288    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-tmp-dir\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:17.201084 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.201056    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd7dcea-e752-445b-8944-954c17642658-kube-api-access-4j74r" (OuterVolumeSpecName: "kube-api-access-4j74r") pod "bfd7dcea-e752-445b-8944-954c17642658" (UID: "bfd7dcea-e752-445b-8944-954c17642658"). InnerVolumeSpecName "kube-api-access-4j74r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 03 23:59:17.201084 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.201069    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-dshm" (OuterVolumeSpecName: "dshm") pod "bfd7dcea-e752-445b-8944-954c17642658" (UID: "bfd7dcea-e752-445b-8944-954c17642658"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 03 23:59:17.201233 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.201199    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfd7dcea-e752-445b-8944-954c17642658-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bfd7dcea-e752-445b-8944-954c17642658" (UID: "bfd7dcea-e752-445b-8944-954c17642658"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 03 23:59:17.299939 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.299901    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j74r\" (UniqueName: \"kubernetes.io/projected/bfd7dcea-e752-445b-8944-954c17642658-kube-api-access-4j74r\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:17.299939 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.299939    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfd7dcea-e752-445b-8944-954c17642658-dshm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:17.300148 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.299954    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfd7dcea-e752-445b-8944-954c17642658-tls-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 03 23:59:17.417740 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.417708    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"]
Aug 03 23:59:17.420987 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.420953    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-0da22152-kserve-7cfcdcb695-p8z5n"]
Aug 03 23:59:17.662015 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.661926    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b60af8d-4ea1-40d3-82f0-037e6d7c9467" path="/var/lib/kubelet/pods/6b60af8d-4ea1-40d3-82f0-037e6d7c9467/volumes"
Aug 03 23:59:17.662554 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:17.662532    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfd7dcea-e752-445b-8944-954c17642658" path="/var/lib/kubelet/pods/bfd7dcea-e752-445b-8944-954c17642658/volumes"
Aug 03 23:59:21.648182 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:21.648149    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:59:33.740424 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:33.740392    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:59:41.050135 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:41.050098    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:59:51.149562 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:51.149484    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 03 23:59:57.683522 ip-10-0-138-58 kubenswrapper[2568]: I0803 23:59:57.683487    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:00:00.144586 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.144548    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763360-4wzps"]
Aug 04 00:00:00.144974 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.144870    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfd7dcea-e752-445b-8944-954c17642658" containerName="main"
Aug 04 00:00:00.144974 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.144881    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd7dcea-e752-445b-8944-954c17642658" containerName="main"
Aug 04 00:00:00.144974 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.144894    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b60af8d-4ea1-40d3-82f0-037e6d7c9467" containerName="main"
Aug 04 00:00:00.144974 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.144900    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b60af8d-4ea1-40d3-82f0-037e6d7c9467" containerName="main"
Aug 04 00:00:00.144974 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.144953    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfd7dcea-e752-445b-8944-954c17642658" containerName="main"
Aug 04 00:00:00.144974 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.144962    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b60af8d-4ea1-40d3-82f0-037e6d7c9467" containerName="main"
Aug 04 00:00:00.149109 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.149088    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763360-4wzps"
Aug 04 00:00:00.151313 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.151286    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9x6w2\""
Aug 04 00:00:00.155801 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.155767    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763360-4wzps"]
Aug 04 00:00:00.177515 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.177493    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763360-4wzps"
Aug 04 00:00:00.320185 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:00.320161    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763360-4wzps"]
Aug 04 00:00:00.323370 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:00:00.323329    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3662e598_2c86_4c21_9b6e_8dfec37c26e6.slice/crio-20e51a716f27110396de0e07764d0738802b2080887fb9d4ce65699e6df25dcb WatchSource:0}: Error finding container 20e51a716f27110396de0e07764d0738802b2080887fb9d4ce65699e6df25dcb: Status 404 returned error can't find the container with id 20e51a716f27110396de0e07764d0738802b2080887fb9d4ce65699e6df25dcb
Aug 04 00:00:01.314343 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:01.314310    2568 generic.go:356] "Generic (PLEG): container finished" podID="3662e598-2c86-4c21-9b6e-8dfec37c26e6" containerID="d18cfed932ee7fb230a436255bf3e7debc88370543dd5350601b4fa164947d3f" exitCode=0
Aug 04 00:00:01.314711 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:01.314344    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763360-4wzps" event={"ID":"3662e598-2c86-4c21-9b6e-8dfec37c26e6","Type":"ContainerDied","Data":"d18cfed932ee7fb230a436255bf3e7debc88370543dd5350601b4fa164947d3f"}
Aug 04 00:00:01.314711 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:01.314406    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763360-4wzps" event={"ID":"3662e598-2c86-4c21-9b6e-8dfec37c26e6","Type":"ContainerStarted","Data":"20e51a716f27110396de0e07764d0738802b2080887fb9d4ce65699e6df25dcb"}
Aug 04 00:00:02.456787 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:02.456762    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763360-4wzps"
Aug 04 00:00:03.324865 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:03.324838    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763360-4wzps"
Aug 04 00:00:03.325042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:03.324841    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763360-4wzps" event={"ID":"3662e598-2c86-4c21-9b6e-8dfec37c26e6","Type":"ContainerDied","Data":"20e51a716f27110396de0e07764d0738802b2080887fb9d4ce65699e6df25dcb"}
Aug 04 00:00:03.325042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:03.324960    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20e51a716f27110396de0e07764d0738802b2080887fb9d4ce65699e6df25dcb"
Aug 04 00:00:06.646674 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:06.646644    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:00:06.749377 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:06.749338    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:00:10.641594 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:10.641555    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:00:16.540843 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:16.540791    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:00:24.940820 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:24.940779    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:00:31.249183 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:31.249147    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:00:38.138904 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:38.138862    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:00:52.040756 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:52.040721    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:00:58.342365 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:00:58.342321    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:01:08.249813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:01:08.249770    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:01:14.746936 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:01:14.746902    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:01:23.846859 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:01:23.846763    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:01:31.445682 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:01:31.445643    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:01:40.848032 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:01:40.847995    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:01:50.942377 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:01:50.942341    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:01:56.243898 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:01:56.243845    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:02:10.839844 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:10.839808    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:02:17.138207 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:17.138173    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:02:20.762630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:20.762573    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:23.747733 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:23.747695    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:02:34.440870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:34.440827    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:02:36.636202 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:36.636166    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:43.041832 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:43.041791    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:02:45.938803 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:45.938761    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:48.857944 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:48.857900    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:48.961172 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:48.961138    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:49.269642 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:49.269603    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:50.552651 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:50.552596    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:02:55.501459 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.501418    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:55.601798 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.601762    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:55.712376 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.712329    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:55.965828 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.965747    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"]
Aug 04 00:02:55.966139 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.966123    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3662e598-2c86-4c21-9b6e-8dfec37c26e6" containerName="cleanup"
Aug 04 00:02:55.966180 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.966143    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3662e598-2c86-4c21-9b6e-8dfec37c26e6" containerName="cleanup"
Aug 04 00:02:55.966222 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.966211    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3662e598-2c86-4c21-9b6e-8dfec37c26e6" containerName="cleanup"
Aug 04 00:02:55.969511 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.969491    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:55.971777 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.971759    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f9c1edcb-openshift-default-dockercfg-tzljx\""
Aug 04 00:02:55.987685 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.987662    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"]
Aug 04 00:02:55.991052 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:55.990978    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:56.082042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.082012    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-data\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.082223 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.082051    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-envoy\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.082223 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.082073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-token\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.082223 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.082091    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9wzx\" (UniqueName: \"kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-kube-api-access-c9wzx\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.082223 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.082173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-podinfo\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.082223 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.082215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-socket\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.082425 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.082241    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istiod-ca-cert\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.082425 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.082331    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-credential-socket\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.082425 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.082361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-certs\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.179436 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.179401    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:56.183426 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-socket\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.183506 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istiod-ca-cert\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.183506 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183483    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-credential-socket\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.183583 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-certs\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.183583 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183530    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-data\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.183583 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183566    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-envoy\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.183729 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183597    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-token\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.183729 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9wzx\" (UniqueName: \"kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-kube-api-access-c9wzx\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.183729 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-podinfo\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.183877 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183844    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-socket\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.183954 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.183926    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-credential-socket\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.184072 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.184052    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-data\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.184346 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.184322    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-certs\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.184417 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.184363    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istiod-ca-cert\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.185935 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.185916    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-envoy\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.186139 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.186123    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-podinfo\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.191822 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.191799    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9wzx\" (UniqueName: \"kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-kube-api-access-c9wzx\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.191939 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.191852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-token\") pod \"e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") " pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.278931 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.278885    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:56.419146 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.419108    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"]
Aug 04 00:02:56.422403 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:02:56.422375    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eaa6d33_3d62_40d4_8d9e_8051f5118308.slice/crio-922eb76b1532b4191dd347c258357ccce44356647d7e78cb6831464a5b692f96 WatchSource:0}: Error finding container 922eb76b1532b4191dd347c258357ccce44356647d7e78cb6831464a5b692f96: Status 404 returned error can't find the container with id 922eb76b1532b4191dd347c258357ccce44356647d7e78cb6831464a5b692f96
Aug 04 00:02:56.424612 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.424574    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:02:56.424720 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.424659    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:02:56.424720 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:56.424704    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:02:57.176997 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:57.176957    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" event={"ID":"2eaa6d33-3d62-40d4-8d9e-8051f5118308","Type":"ContainerStarted","Data":"7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac"}
Aug 04 00:02:57.177488 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:57.177044    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" event={"ID":"2eaa6d33-3d62-40d4-8d9e-8051f5118308","Type":"ContainerStarted","Data":"922eb76b1532b4191dd347c258357ccce44356647d7e78cb6831464a5b692f96"}
Aug 04 00:02:57.196729 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:57.196672    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" podStartSLOduration=2.196656711 podStartE2EDuration="2.196656711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:57.195085671 +0000 UTC m=+1978.081414152" watchObservedRunningTime="2026-08-04 00:02:57.196656711 +0000 UTC m=+1978.082985176"
Aug 04 00:02:57.280004 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:57.279967    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:57.284927 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:57.284901    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:58.182831 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:58.182803    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:58.183935 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:58.183914    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:02:58.514081 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:58.514040    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:02:58.613281 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:02:58.613240    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:01.799981 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:01.799949    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:01.852984 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:01.852940    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:03.147182 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:03.147143    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:03:13.184339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:13.184295    2568 patch_prober.go:28] interesting pod/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Aug 04 00:03:13.184756 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:13.184373    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Aug 04 00:03:13.264614 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:13.264580    2568 generic.go:356] "Generic (PLEG): container finished" podID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerID="7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac" exitCode=0
Aug 04 00:03:13.264783 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:13.264658    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" event={"ID":"2eaa6d33-3d62-40d4-8d9e-8051f5118308","Type":"ContainerDied","Data":"7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac"}
Aug 04 00:03:13.265055 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:13.265042    2568 scope.go:117] "RemoveContainer" containerID="7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac"
Aug 04 00:03:13.266081 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:13.266047    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:03:13.266197 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:13.266139    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:03:13.266285 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:13.266192    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:03:14.271580 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:14.271535    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" event={"ID":"2eaa6d33-3d62-40d4-8d9e-8051f5118308","Type":"ContainerStarted","Data":"7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157"}
Aug 04 00:03:14.279020 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:14.278996    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:03:14.279239 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:14.279213    2568 patch_prober.go:28] interesting pod/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Aug 04 00:03:14.279316 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:14.279291    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Aug 04 00:03:15.279782 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:15.279749    2568 patch_prober.go:28] interesting pod/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Aug 04 00:03:15.280180 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:15.279812    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Aug 04 00:03:16.280044 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:16.280009    2568 patch_prober.go:28] interesting pod/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Aug 04 00:03:16.280523 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:16.280072    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Aug 04 00:03:17.279643 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:17.279606    2568 patch_prober.go:28] interesting pod/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Aug 04 00:03:17.279825 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:17.279659    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Aug 04 00:03:18.280126 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:18.280088    2568 patch_prober.go:28] interesting pod/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Aug 04 00:03:18.280577 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:18.280143    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Aug 04 00:03:19.280248 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:19.280201    2568 patch_prober.go:28] interesting pod/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Aug 04 00:03:19.280873 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:19.280298    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Aug 04 00:03:20.283505 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:20.283472    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:03:20.283902 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:20.283773    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:03:20.284468 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:20.284447    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:03:40.215049 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:40.215009    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:40.653730 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:40.653693    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"]
Aug 04 00:03:40.654051 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:40.654001    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy" containerID="cri-o://7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157" gracePeriod=30
Aug 04 00:03:41.520037 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.519999    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:41.771612 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.771529    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"]
Aug 04 00:03:41.773819 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.773804    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.775910 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.775888    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-50db8767-gw-openshift-default-dockercfg-ssp67\""
Aug 04 00:03:41.790338 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.790306    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-credential-socket\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.790533 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.790514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-certs\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.790651 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.790635    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-token\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.790777 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.790760    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-socket\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.790921 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.790905    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-podinfo\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.791059 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.791043    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qpnr\" (UniqueName: \"kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-kube-api-access-2qpnr\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.791192 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.791170    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-data\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.791348 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.791215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-envoy\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.791348 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.791243    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istiod-ca-cert\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.793252 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.793226    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"]
Aug 04 00:03:41.814470 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.814437    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:41.892416 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.892379    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-envoy\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.892416 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.892428    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istiod-ca-cert\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.892680 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.892499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-credential-socket\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.892680 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.892522    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-certs\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.892680 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.892548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-token\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.892680 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.892582    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-socket\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.892680 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.892643    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-podinfo\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.892937 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.892683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qpnr\" (UniqueName: \"kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-kube-api-access-2qpnr\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.892937 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.892729    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-data\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.893117 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.893094    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-data\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.893341 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.893316    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istiod-ca-cert\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.893454 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.893360    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-credential-socket\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.893602 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.893579    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-socket\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.893844 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.893823    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-certs\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.896460 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.896430    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-envoy\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.897648 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.897596    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-podinfo\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.903345 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.903316    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-token\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:41.903439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:41.903321    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qpnr\" (UniqueName: \"kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-kube-api-access-2qpnr\") pod \"e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") " pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:42.083394 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:42.083297    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:42.188385 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:42.188348    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:42.229881 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:42.229847    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"]
Aug 04 00:03:42.233229 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:03:42.233202    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78c61e1_2a74_48ca_ba40_b8857dfc22d2.slice/crio-03cd1d0e8bd9772979be4c57b4667032e3198d95ae6f41f2f9274ea79045dbc8 WatchSource:0}: Error finding container 03cd1d0e8bd9772979be4c57b4667032e3198d95ae6f41f2f9274ea79045dbc8: Status 404 returned error can't find the container with id 03cd1d0e8bd9772979be4c57b4667032e3198d95ae6f41f2f9274ea79045dbc8
Aug 04 00:03:42.235497 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:42.235463    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:03:42.235608 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:42.235545    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:03:42.235608 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:42.235591    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:03:42.406697 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:42.406597    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" event={"ID":"a78c61e1-2a74-48ca-ba40-b8857dfc22d2","Type":"ContainerStarted","Data":"c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0"}
Aug 04 00:03:42.406697 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:42.406667    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" event={"ID":"a78c61e1-2a74-48ca-ba40-b8857dfc22d2","Type":"ContainerStarted","Data":"03cd1d0e8bd9772979be4c57b4667032e3198d95ae6f41f2f9274ea79045dbc8"}
Aug 04 00:03:42.424793 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:42.424736    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" podStartSLOduration=1.424722164 podStartE2EDuration="1.424722164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:42.42306879 +0000 UTC m=+2023.309397285" watchObservedRunningTime="2026-08-04 00:03:42.424722164 +0000 UTC m=+2023.311050628"
Aug 04 00:03:43.084288 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:43.084231    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:43.089580 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:43.089554    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:43.411074 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:43.410993    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:43.412068 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:43.412043    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:43.444282 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:43.440659    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:03:43.873420 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:43.873388    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:43.970700 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:43.970664    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:44.383721 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:44.383686    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:44.551470 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:44.551438    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:44.644246 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:44.644153    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:03:45.899618 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.899592    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:03:45.930009 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.929924    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-certs\") pod \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") "
Aug 04 00:03:45.930009 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.929976    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-token\") pod \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") "
Aug 04 00:03:45.930009 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930000    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-podinfo\") pod \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") "
Aug 04 00:03:45.930298 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930027    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-credential-socket\") pod \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") "
Aug 04 00:03:45.930298 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930066    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-envoy\") pod \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") "
Aug 04 00:03:45.930298 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930117    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-data\") pod \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") "
Aug 04 00:03:45.930298 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930148    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9wzx\" (UniqueName: \"kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-kube-api-access-c9wzx\") pod \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") "
Aug 04 00:03:45.930298 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930178    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-socket\") pod \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") "
Aug 04 00:03:45.930298 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930239    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istiod-ca-cert\") pod \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\" (UID: \"2eaa6d33-3d62-40d4-8d9e-8051f5118308\") "
Aug 04 00:03:45.930610 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930302    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2eaa6d33-3d62-40d4-8d9e-8051f5118308" (UID: "2eaa6d33-3d62-40d4-8d9e-8051f5118308"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:03:45.930610 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930320    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2eaa6d33-3d62-40d4-8d9e-8051f5118308" (UID: "2eaa6d33-3d62-40d4-8d9e-8051f5118308"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:03:45.930610 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930541    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-data" (OuterVolumeSpecName: "istio-data") pod "2eaa6d33-3d62-40d4-8d9e-8051f5118308" (UID: "2eaa6d33-3d62-40d4-8d9e-8051f5118308"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:03:45.930610 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930606    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:03:45.930813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930625    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:03:45.930813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930638    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:03:45.930813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.930653    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2eaa6d33-3d62-40d4-8d9e-8051f5118308" (UID: "2eaa6d33-3d62-40d4-8d9e-8051f5118308"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:03:45.931038 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.931004    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2eaa6d33-3d62-40d4-8d9e-8051f5118308" (UID: "2eaa6d33-3d62-40d4-8d9e-8051f5118308"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:03:45.932400 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.932377    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-token" (OuterVolumeSpecName: "istio-token") pod "2eaa6d33-3d62-40d4-8d9e-8051f5118308" (UID: "2eaa6d33-3d62-40d4-8d9e-8051f5118308"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:03:45.932884 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.932863    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2eaa6d33-3d62-40d4-8d9e-8051f5118308" (UID: "2eaa6d33-3d62-40d4-8d9e-8051f5118308"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:03:45.932936 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.932871    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2eaa6d33-3d62-40d4-8d9e-8051f5118308" (UID: "2eaa6d33-3d62-40d4-8d9e-8051f5118308"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:03:45.933029 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:45.933010    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-kube-api-access-c9wzx" (OuterVolumeSpecName: "kube-api-access-c9wzx") pod "2eaa6d33-3d62-40d4-8d9e-8051f5118308" (UID: "2eaa6d33-3d62-40d4-8d9e-8051f5118308"). InnerVolumeSpecName "kube-api-access-c9wzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:03:46.031084 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.031044    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:03:46.031084 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.031078    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:03:46.031084 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.031087    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:03:46.031375 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.031096    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9wzx\" (UniqueName: \"kubernetes.io/projected/2eaa6d33-3d62-40d4-8d9e-8051f5118308-kube-api-access-c9wzx\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:03:46.031375 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.031106    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eaa6d33-3d62-40d4-8d9e-8051f5118308-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:03:46.031375 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.031114    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eaa6d33-3d62-40d4-8d9e-8051f5118308-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:03:46.426630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.426594    2568 generic.go:356] "Generic (PLEG): container finished" podID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerID="7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157" exitCode=0
Aug 04 00:03:46.426833 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.426657    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"
Aug 04 00:03:46.426833 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.426674    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" event={"ID":"2eaa6d33-3d62-40d4-8d9e-8051f5118308","Type":"ContainerDied","Data":"7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157"}
Aug 04 00:03:46.426833 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.426740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm" event={"ID":"2eaa6d33-3d62-40d4-8d9e-8051f5118308","Type":"ContainerDied","Data":"922eb76b1532b4191dd347c258357ccce44356647d7e78cb6831464a5b692f96"}
Aug 04 00:03:46.426833 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.426770    2568 scope.go:117] "RemoveContainer" containerID="7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157"
Aug 04 00:03:46.435765 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.435748    2568 scope.go:117] "RemoveContainer" containerID="7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac"
Aug 04 00:03:46.443954 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.443934    2568 scope.go:117] "RemoveContainer" containerID="7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157"
Aug 04 00:03:46.444322 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:03:46.444236    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157\": container with ID starting with 7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157 not found: ID does not exist" containerID="7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157"
Aug 04 00:03:46.444322 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.444286    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157"} err="failed to get container status \"7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157\": rpc error: code = NotFound desc = could not find container \"7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157\": container with ID starting with 7b8c7dc83c6621e52c92e4282d432fd2633eac00e91d9a1b6702ce30afab1157 not found: ID does not exist"
Aug 04 00:03:46.444322 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.444304    2568 scope.go:117] "RemoveContainer" containerID="7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac"
Aug 04 00:03:46.444848 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:03:46.444812    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac\": container with ID starting with 7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac not found: ID does not exist" containerID="7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac"
Aug 04 00:03:46.444928 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.444845    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac"} err="failed to get container status \"7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac\": rpc error: code = NotFound desc = could not find container \"7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac\": container with ID starting with 7384db81c86ed3ca1e7e0b6f56f8a1b8ebbe09c331ae9c5ec64d1399481799ac not found: ID does not exist"
Aug 04 00:03:46.446792 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.446769    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"]
Aug 04 00:03:46.449329 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:46.449307    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f9c1edcb-openshift-default-dfc664dc4-vlzgm"]
Aug 04 00:03:47.662160 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:47.662128    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" path="/var/lib/kubelet/pods/2eaa6d33-3d62-40d4-8d9e-8051f5118308/volumes"
Aug 04 00:03:52.252118 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:52.252071    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:03:57.479439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:57.479404    2568 generic.go:356] "Generic (PLEG): container finished" podID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerID="c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0" exitCode=0
Aug 04 00:03:57.479910 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:57.479482    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" event={"ID":"a78c61e1-2a74-48ca-ba40-b8857dfc22d2","Type":"ContainerDied","Data":"c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0"}
Aug 04 00:03:57.479966 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:57.479908    2568 scope.go:117] "RemoveContainer" containerID="c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0"
Aug 04 00:03:57.481014 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:57.480980    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:03:57.481076 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:57.481063    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:03:57.481114 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:57.481102    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:03:58.411517 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:58.411469    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:58.486719 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:58.486681    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" event={"ID":"a78c61e1-2a74-48ca-ba40-b8857dfc22d2","Type":"ContainerStarted","Data":"46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8"}
Aug 04 00:03:59.084066 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:59.084022    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:03:59.085172 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:59.085142    2568 patch_prober.go:28] interesting pod/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:03:59.085330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:03:59.085229    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:04:00.084152 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:00.084059    2568 patch_prober.go:28] interesting pod/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:04:00.084152 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:00.084131    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:04:01.084206 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:01.084167    2568 patch_prober.go:28] interesting pod/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:04:01.084609 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:01.084228    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:04:02.084276 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:02.084235    2568 patch_prober.go:28] interesting pod/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:04:02.084684 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:02.084331    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:04:03.083742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:03.083702    2568 patch_prober.go:28] interesting pod/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:04:03.083938 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:03.083763    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:04:04.087649 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:04.087618    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:04:04.088044 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:04.087873    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:04:04.088568 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:04.088552    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:04:14.499839 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:14.499798    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:14.601086 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:14.601050    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:14.673280 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:14.673228    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:14.733620 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:14.733585    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:14.804831 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:14.804732    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"]
Aug 04 00:04:14.805035 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:14.805005    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy" containerID="cri-o://46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8" gracePeriod=30
Aug 04 00:04:14.814315 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:14.814255    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:15.052067 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.052029    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:15.284489 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.284451    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:15.557128 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.557045    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"]
Aug 04 00:04:15.557616 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.557596    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy"
Aug 04 00:04:15.557679 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.557622    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy"
Aug 04 00:04:15.557679 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.557650    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy"
Aug 04 00:04:15.557679 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.557659    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy"
Aug 04 00:04:15.557785 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.557745    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy"
Aug 04 00:04:15.557785 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.557757    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eaa6d33-3d62-40d4-8d9e-8051f5118308" containerName="istio-proxy"
Aug 04 00:04:15.561161 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.561136    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.563924 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.563903    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3113ce29-openshift-default-dockercfg-f7ppb\""
Aug 04 00:04:15.571404 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.571377    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"]
Aug 04 00:04:15.581321 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.581294    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:15.701597 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.701554    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwfj8\" (UniqueName: \"kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-kube-api-access-gwfj8\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.701797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.701621    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-certs\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.701797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.701664    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-socket\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.701797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.701700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-data\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.701797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.701734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-envoy\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.701797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.701762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adf3607a-c248-4848-aa07-562b03d02585-istio-podinfo\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.701797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.701786    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-istio-token\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.702042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.701810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adf3607a-c248-4848-aa07-562b03d02585-istiod-ca-cert\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.702042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.701859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-credential-socket\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803119 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803079    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfj8\" (UniqueName: \"kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-kube-api-access-gwfj8\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803348 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-certs\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803348 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-socket\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803348 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-data\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803348 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-envoy\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803440    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adf3607a-c248-4848-aa07-562b03d02585-istio-podinfo\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-istio-token\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adf3607a-c248-4848-aa07-562b03d02585-istiod-ca-cert\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-credential-socket\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803808 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803715    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-certs\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803808 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-data\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.803926 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.803836    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-socket\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.804191 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.804172    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-credential-socket\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.804393 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.804375    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adf3607a-c248-4848-aa07-562b03d02585-istiod-ca-cert\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.806226 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.806207    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-envoy\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.806576 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.806555    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adf3607a-c248-4848-aa07-562b03d02585-istio-podinfo\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.812350 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.812299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwfj8\" (UniqueName: \"kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-kube-api-access-gwfj8\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.812350 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.812305    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-istio-token\") pod \"e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") " pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:15.874204 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:15.874153    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:16.017540 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:16.017468    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"]
Aug 04 00:04:16.024238 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:16.024189    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:04:16.024384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:16.024305    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:04:16.024384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:16.024352    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:04:16.040436 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:16.040408    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:16.581090 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:16.581056    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" event={"ID":"adf3607a-c248-4848-aa07-562b03d02585","Type":"ContainerStarted","Data":"ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df"}
Aug 04 00:04:16.581482 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:16.581106    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" event={"ID":"adf3607a-c248-4848-aa07-562b03d02585","Type":"ContainerStarted","Data":"a31121cfac8f3ee561ed51201e82283be15e298d64fe4451e882340d077ffb6d"}
Aug 04 00:04:16.600772 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:16.600715    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" podStartSLOduration=1.600697214 podStartE2EDuration="1.600697214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:04:16.599474341 +0000 UTC m=+2057.485802819" watchObservedRunningTime="2026-08-04 00:04:16.600697214 +0000 UTC m=+2057.487025679"
Aug 04 00:04:16.875155 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:16.875063    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:17.446813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:17.446774    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:04:17.880647 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:17.880614    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:17.930692 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:17.930660    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:18.030270 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:18.030234    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:18.589752 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:18.589714    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:18.590852 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:18.590828    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:19.090801 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:19.090762    2568 patch_prober.go:28] interesting pod/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 00:04:19.091192 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:19.090840    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:04:19.215612 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:19.215581    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:19.405477 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:19.405385    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:19.768072 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:19.768036    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:19.862810 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:19.862776    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:20.071167 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.071142    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:04:20.248164 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248127    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-socket\") pod \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") "
Aug 04 00:04:20.248164 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248164    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-data\") pod \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") "
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248208    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qpnr\" (UniqueName: \"kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-kube-api-access-2qpnr\") pod \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") "
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248242    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-certs\") pod \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") "
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248305    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-podinfo\") pod \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") "
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248344    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-credential-socket\") pod \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") "
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248372    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-envoy\") pod \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") "
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248406    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-token\") pod \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") "
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248428    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istiod-ca-cert\") pod \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\" (UID: \"a78c61e1-2a74-48ca-ba40-b8857dfc22d2\") "
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248507    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a78c61e1-2a74-48ca-ba40-b8857dfc22d2" (UID: "a78c61e1-2a74-48ca-ba40-b8857dfc22d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248558    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "a78c61e1-2a74-48ca-ba40-b8857dfc22d2" (UID: "a78c61e1-2a74-48ca-ba40-b8857dfc22d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248664    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a78c61e1-2a74-48ca-ba40-b8857dfc22d2" (UID: "a78c61e1-2a74-48ca-ba40-b8857dfc22d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:20.248742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248739    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a78c61e1-2a74-48ca-ba40-b8857dfc22d2" (UID: "a78c61e1-2a74-48ca-ba40-b8857dfc22d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:20.249485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248830    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:20.249485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248850    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:20.249485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248863    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:20.249485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.248876    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:20.249485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.249094    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a78c61e1-2a74-48ca-ba40-b8857dfc22d2" (UID: "a78c61e1-2a74-48ca-ba40-b8857dfc22d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:20.250764 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.250732    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a78c61e1-2a74-48ca-ba40-b8857dfc22d2" (UID: "a78c61e1-2a74-48ca-ba40-b8857dfc22d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:20.250764 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.250749    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "a78c61e1-2a74-48ca-ba40-b8857dfc22d2" (UID: "a78c61e1-2a74-48ca-ba40-b8857dfc22d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:20.251123 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.251103    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a78c61e1-2a74-48ca-ba40-b8857dfc22d2" (UID: "a78c61e1-2a74-48ca-ba40-b8857dfc22d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:04:20.251176 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.251123    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-kube-api-access-2qpnr" (OuterVolumeSpecName: "kube-api-access-2qpnr") pod "a78c61e1-2a74-48ca-ba40-b8857dfc22d2" (UID: "a78c61e1-2a74-48ca-ba40-b8857dfc22d2"). InnerVolumeSpecName "kube-api-access-2qpnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:20.349718 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.349617    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:20.349718 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.349654    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:20.349718 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.349666    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qpnr\" (UniqueName: \"kubernetes.io/projected/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-kube-api-access-2qpnr\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:20.349718 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.349679    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:20.349718 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.349690    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a78c61e1-2a74-48ca-ba40-b8857dfc22d2-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:20.602791 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.602702    2568 generic.go:356] "Generic (PLEG): container finished" podID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerID="46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8" exitCode=0
Aug 04 00:04:20.602791 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.602758    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"
Aug 04 00:04:20.602994 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.602791    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" event={"ID":"a78c61e1-2a74-48ca-ba40-b8857dfc22d2","Type":"ContainerDied","Data":"46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8"}
Aug 04 00:04:20.602994 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.602852    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns" event={"ID":"a78c61e1-2a74-48ca-ba40-b8857dfc22d2","Type":"ContainerDied","Data":"03cd1d0e8bd9772979be4c57b4667032e3198d95ae6f41f2f9274ea79045dbc8"}
Aug 04 00:04:20.602994 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.602883    2568 scope.go:117] "RemoveContainer" containerID="46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8"
Aug 04 00:04:20.613644 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.613615    2568 scope.go:117] "RemoveContainer" containerID="c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0"
Aug 04 00:04:20.622310 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.622290    2568 scope.go:117] "RemoveContainer" containerID="46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8"
Aug 04 00:04:20.623134 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:04:20.622842    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8\": container with ID starting with 46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8 not found: ID does not exist" containerID="46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8"
Aug 04 00:04:20.623134 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.622902    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8"} err="failed to get container status \"46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8\": rpc error: code = NotFound desc = could not find container \"46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8\": container with ID starting with 46b66002871318d6e2c5e51ea6cac88888aed14bd17cc8477bae3ed7250639b8 not found: ID does not exist"
Aug 04 00:04:20.623134 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.622926    2568 scope.go:117] "RemoveContainer" containerID="c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0"
Aug 04 00:04:20.625638 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:04:20.625594    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0\": container with ID starting with c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0 not found: ID does not exist" containerID="c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0"
Aug 04 00:04:20.625817 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.625784    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0"} err="failed to get container status \"c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0\": rpc error: code = NotFound desc = could not find container \"c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0\": container with ID starting with c02e0dfc6841fdadb81cde59345d2846594d74525586e34ce861bd1cb426b0f0 not found: ID does not exist"
Aug 04 00:04:20.626162 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.626136    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"]
Aug 04 00:04:20.629955 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:20.629930    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-50db8767-gw-openshift-default-77cf5477dd-znlns"]
Aug 04 00:04:21.661605 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:21.661561    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" path="/var/lib/kubelet/pods/a78c61e1-2a74-48ca-ba40-b8857dfc22d2/volumes"
Aug 04 00:04:27.058426 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:27.058385    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:04:32.663829 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:32.663796    2568 generic.go:356] "Generic (PLEG): container finished" podID="adf3607a-c248-4848-aa07-562b03d02585" containerID="ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df" exitCode=0
Aug 04 00:04:32.663829 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:32.663833    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" event={"ID":"adf3607a-c248-4848-aa07-562b03d02585","Type":"ContainerDied","Data":"ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df"}
Aug 04 00:04:32.664316 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:32.664199    2568 scope.go:117] "RemoveContainer" containerID="ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df"
Aug 04 00:04:32.665304 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:32.665244    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:04:32.665381 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:32.665362    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:04:32.665443 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:32.665428    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:04:33.590657 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:33.590618    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:33.670220 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:33.670186    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" event={"ID":"adf3607a-c248-4848-aa07-562b03d02585","Type":"ContainerStarted","Data":"e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f"}
Aug 04 00:04:33.874809 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:33.874714    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:33.875853 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:33.875822    2568 patch_prober.go:28] interesting pod/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Aug 04 00:04:33.875997 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:33.875886    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Aug 04 00:04:34.875235 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:34.875194    2568 patch_prober.go:28] interesting pod/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Aug 04 00:04:34.875684 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:34.875250    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Aug 04 00:04:35.874794 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:35.874755    2568 patch_prober.go:28] interesting pod/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Aug 04 00:04:35.874986 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:35.874815    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Aug 04 00:04:36.875233 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:36.875196    2568 patch_prober.go:28] interesting pod/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Aug 04 00:04:36.875678 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:36.875285    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Aug 04 00:04:37.875328 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:37.875287    2568 patch_prober.go:28] interesting pod/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Aug 04 00:04:37.875818 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:37.875372    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Aug 04 00:04:38.878992 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:38.878964    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:38.879419 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:38.879224    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:38.879912 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:38.879894    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:49.499484 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:49.499426    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:49.573325 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:49.573285    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:49.640171 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:49.640126    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:49.696934 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:49.696892    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:50.778975 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:50.778942    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"]
Aug 04 00:04:50.779428 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:50.779155    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy" containerID="cri-o://e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f" gracePeriod=30
Aug 04 00:04:50.791908 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:50.791872    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:51.011427 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.011386    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:51.490348 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.490309    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"]
Aug 04 00:04:51.490841 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.490810    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy"
Aug 04 00:04:51.491010 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.490879    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy"
Aug 04 00:04:51.491104 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.491067    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy"
Aug 04 00:04:51.491104 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.491083    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy"
Aug 04 00:04:51.493360 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.493342    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.495755 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.495732    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7b45e0cc-openshift-default-dockercfg-kf2w8\""
Aug 04 00:04:51.505725 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.505702    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"]
Aug 04 00:04:51.644550 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.644514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-data\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.644766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.644558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-certs\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.644766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.644583    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-socket\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.644766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.644600    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-istio-token\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.644766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.644649    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl64s\" (UniqueName: \"kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-kube-api-access-tl64s\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.644766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.644714    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-envoy\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.644766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.644745    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-credential-socket\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.645022 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.644793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99721c65-521b-439c-ad79-68f87f3528a1-istio-podinfo\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.645022 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.644822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99721c65-521b-439c-ad79-68f87f3528a1-istiod-ca-cert\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746320 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-data\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746320 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746255    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-certs\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746320 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746301    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-socket\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746625 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746326    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-istio-token\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746625 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746350    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl64s\" (UniqueName: \"kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-kube-api-access-tl64s\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746625 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-envoy\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746625 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-credential-socket\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746625 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746625    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99721c65-521b-439c-ad79-68f87f3528a1-istio-podinfo\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746932 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99721c65-521b-439c-ad79-68f87f3528a1-istiod-ca-cert\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746932 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746666    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-data\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.746932 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.746699    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-certs\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.747085 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.747011    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-socket\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.747143 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.747091    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-credential-socket\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.747468 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.747403    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99721c65-521b-439c-ad79-68f87f3528a1-istiod-ca-cert\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.748978 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.748952    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-envoy\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.749303 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.749283    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99721c65-521b-439c-ad79-68f87f3528a1-istio-podinfo\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.754072 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.754044    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-istio-token\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.754176 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.754115    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl64s\" (UniqueName: \"kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-kube-api-access-tl64s\") pod \"e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") " pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.805183 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.805149    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:51.944671 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.944629    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"]
Aug 04 00:04:51.947016 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:04:51.946977    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99721c65_521b_439c_ad79_68f87f3528a1.slice/crio-f16684cbd450fd046c2c9f551aa5fe2235bc8b7eb962e22eee4675005b1fd117 WatchSource:0}: Error finding container f16684cbd450fd046c2c9f551aa5fe2235bc8b7eb962e22eee4675005b1fd117: Status 404 returned error can't find the container with id f16684cbd450fd046c2c9f551aa5fe2235bc8b7eb962e22eee4675005b1fd117
Aug 04 00:04:51.949330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.949292    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:04:51.949439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.949376    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:04:51.949439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:51.949420    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:04:52.520069 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:52.520032    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:52.547937 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:52.547901    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:04:52.621068 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:52.621038    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:52.772929 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:52.772832    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" event={"ID":"99721c65-521b-439c-ad79-68f87f3528a1","Type":"ContainerStarted","Data":"714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029"}
Aug 04 00:04:52.772929 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:52.772886    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" event={"ID":"99721c65-521b-439c-ad79-68f87f3528a1","Type":"ContainerStarted","Data":"f16684cbd450fd046c2c9f551aa5fe2235bc8b7eb962e22eee4675005b1fd117"}
Aug 04 00:04:52.791642 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:52.791569    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" podStartSLOduration=1.791546548 podStartE2EDuration="1.791546548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:04:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:04:52.790025761 +0000 UTC m=+2093.676354222" watchObservedRunningTime="2026-08-04 00:04:52.791546548 +0000 UTC m=+2093.677875014"
Aug 04 00:04:52.805597 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:52.805561    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:53.810866 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:53.810829    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:53.881546 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:53.881514    2568 patch_prober.go:28] interesting pod/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Aug 04 00:04:53.881716 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:53.881572    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:04:54.135465 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:54.135385    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:54.235631 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:54.235593    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:54.781618 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:54.781591    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:54.782609 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:54.782587    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:04:55.267840 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:55.267803    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:55.325365 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:55.325330    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:55.772305 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:55.772251    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:55.875094 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:55.875059    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:04:56.054582 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.054558    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:56.191149 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191110    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adf3607a-c248-4848-aa07-562b03d02585-istio-podinfo\") pod \"adf3607a-c248-4848-aa07-562b03d02585\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") "
Aug 04 00:04:56.191384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191174    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adf3607a-c248-4848-aa07-562b03d02585-istiod-ca-cert\") pod \"adf3607a-c248-4848-aa07-562b03d02585\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") "
Aug 04 00:04:56.191384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191195    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-socket\") pod \"adf3607a-c248-4848-aa07-562b03d02585\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") "
Aug 04 00:04:56.191384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191221    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-envoy\") pod \"adf3607a-c248-4848-aa07-562b03d02585\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") "
Aug 04 00:04:56.191384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191246    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-istio-token\") pod \"adf3607a-c248-4848-aa07-562b03d02585\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") "
Aug 04 00:04:56.191384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191309    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwfj8\" (UniqueName: \"kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-kube-api-access-gwfj8\") pod \"adf3607a-c248-4848-aa07-562b03d02585\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") "
Aug 04 00:04:56.191384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191368    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-data\") pod \"adf3607a-c248-4848-aa07-562b03d02585\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") "
Aug 04 00:04:56.191710 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191413    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-certs\") pod \"adf3607a-c248-4848-aa07-562b03d02585\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") "
Aug 04 00:04:56.191710 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191470    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-credential-socket\") pod \"adf3607a-c248-4848-aa07-562b03d02585\" (UID: \"adf3607a-c248-4848-aa07-562b03d02585\") "
Aug 04 00:04:56.191710 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191532    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "adf3607a-c248-4848-aa07-562b03d02585" (UID: "adf3607a-c248-4848-aa07-562b03d02585"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:56.191875 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191732    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "adf3607a-c248-4848-aa07-562b03d02585" (UID: "adf3607a-c248-4848-aa07-562b03d02585"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:56.191875 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191812    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:56.191875 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191832    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:56.192024 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.191932    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-data" (OuterVolumeSpecName: "istio-data") pod "adf3607a-c248-4848-aa07-562b03d02585" (UID: "adf3607a-c248-4848-aa07-562b03d02585"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:56.192077 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.192062    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "adf3607a-c248-4848-aa07-562b03d02585" (UID: "adf3607a-c248-4848-aa07-562b03d02585"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:56.192331 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.192303    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf3607a-c248-4848-aa07-562b03d02585-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "adf3607a-c248-4848-aa07-562b03d02585" (UID: "adf3607a-c248-4848-aa07-562b03d02585"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:56.194213 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.194147    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/adf3607a-c248-4848-aa07-562b03d02585-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "adf3607a-c248-4848-aa07-562b03d02585" (UID: "adf3607a-c248-4848-aa07-562b03d02585"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:04:56.194771 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.194735    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-kube-api-access-gwfj8" (OuterVolumeSpecName: "kube-api-access-gwfj8") pod "adf3607a-c248-4848-aa07-562b03d02585" (UID: "adf3607a-c248-4848-aa07-562b03d02585"). InnerVolumeSpecName "kube-api-access-gwfj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:56.194868 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.194822    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "adf3607a-c248-4848-aa07-562b03d02585" (UID: "adf3607a-c248-4848-aa07-562b03d02585"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:56.195052 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.195022    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-istio-token" (OuterVolumeSpecName: "istio-token") pod "adf3607a-c248-4848-aa07-562b03d02585" (UID: "adf3607a-c248-4848-aa07-562b03d02585"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:56.292770 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.292675    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adf3607a-c248-4848-aa07-562b03d02585-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:56.292770 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.292712    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adf3607a-c248-4848-aa07-562b03d02585-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:56.292770 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.292726    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:56.292770 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.292739    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:56.292770 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.292754    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwfj8\" (UniqueName: \"kubernetes.io/projected/adf3607a-c248-4848-aa07-562b03d02585-kube-api-access-gwfj8\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:56.293480 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.292768    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:56.293480 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.292800    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adf3607a-c248-4848-aa07-562b03d02585-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:04:56.794806 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.794775    2568 generic.go:356] "Generic (PLEG): container finished" podID="adf3607a-c248-4848-aa07-562b03d02585" containerID="e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f" exitCode=0
Aug 04 00:04:56.794983 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.794847    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"
Aug 04 00:04:56.794983 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.794866    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" event={"ID":"adf3607a-c248-4848-aa07-562b03d02585","Type":"ContainerDied","Data":"e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f"}
Aug 04 00:04:56.794983 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.794930    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh" event={"ID":"adf3607a-c248-4848-aa07-562b03d02585","Type":"ContainerDied","Data":"a31121cfac8f3ee561ed51201e82283be15e298d64fe4451e882340d077ffb6d"}
Aug 04 00:04:56.794983 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.794956    2568 scope.go:117] "RemoveContainer" containerID="e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f"
Aug 04 00:04:56.805073 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.805055    2568 scope.go:117] "RemoveContainer" containerID="ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df"
Aug 04 00:04:56.813637 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.813607    2568 scope.go:117] "RemoveContainer" containerID="e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f"
Aug 04 00:04:56.813882 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:04:56.813864    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f\": container with ID starting with e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f not found: ID does not exist" containerID="e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f"
Aug 04 00:04:56.813975 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.813890    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f"} err="failed to get container status \"e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f\": rpc error: code = NotFound desc = could not find container \"e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f\": container with ID starting with e287e0137e0aedb402cade993cac5fb7e4a5d4762888bcdaed2f4af81217d40f not found: ID does not exist"
Aug 04 00:04:56.813975 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.813908    2568 scope.go:117] "RemoveContainer" containerID="ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df"
Aug 04 00:04:56.814137 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:04:56.814117    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df\": container with ID starting with ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df not found: ID does not exist" containerID="ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df"
Aug 04 00:04:56.814200 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.814144    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df"} err="failed to get container status \"ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df\": rpc error: code = NotFound desc = could not find container \"ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df\": container with ID starting with ef985d6aeea8087d89413f598d2c318ffc65015999d982d53f508c6cd07011df not found: ID does not exist"
Aug 04 00:04:56.818413 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.818390    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"]
Aug 04 00:04:56.822310 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:56.822290    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3113ce29-openshift-default-59857d44f8-hhkrh"]
Aug 04 00:04:57.660913 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:04:57.660872    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf3607a-c248-4848-aa07-562b03d02585" path="/var/lib/kubelet/pods/adf3607a-c248-4848-aa07-562b03d02585/volumes"
Aug 04 00:05:01.648110 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:01.648065    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:05:06.851286 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:06.851238    2568 generic.go:356] "Generic (PLEG): container finished" podID="99721c65-521b-439c-ad79-68f87f3528a1" containerID="714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029" exitCode=0
Aug 04 00:05:06.851700 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:06.851292    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" event={"ID":"99721c65-521b-439c-ad79-68f87f3528a1","Type":"ContainerDied","Data":"714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029"}
Aug 04 00:05:06.851743 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:06.851721    2568 scope.go:117] "RemoveContainer" containerID="714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029"
Aug 04 00:05:06.852811 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:06.852783    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:05:06.852872 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:06.852857    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:05:06.852919 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:06.852905    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:05:07.857804 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:07.857767    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" event={"ID":"99721c65-521b-439c-ad79-68f87f3528a1","Type":"ContainerStarted","Data":"04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f"}
Aug 04 00:05:08.807531 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:08.807487    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:05:08.807962 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:08.807935    2568 patch_prober.go:28] interesting pod/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Aug 04 00:05:08.808168 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:08.808139    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Aug 04 00:05:09.781910 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:09.781878    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:05:09.806182 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:09.806141    2568 patch_prober.go:28] interesting pod/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Aug 04 00:05:09.806515 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:09.806484    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Aug 04 00:05:10.805694 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:10.805647    2568 patch_prober.go:28] interesting pod/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Aug 04 00:05:10.806211 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:10.805725    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Aug 04 00:05:11.805675 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:11.805625    2568 patch_prober.go:28] interesting pod/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Aug 04 00:05:11.805891 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:11.805701    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Aug 04 00:05:12.821865 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:12.821834    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:05:12.823133 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:12.823111    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:05:17.022862 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:17.022824    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:35.806898 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:35.806856    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:36.098714 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:36.098611    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"]
Aug 04 00:05:36.098939 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:36.098906    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy" containerID="cri-o://04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f" gracePeriod=30
Aug 04 00:05:36.599327 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:36.599288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:36.648445 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:36.648413    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:36.791962 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:36.791929    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:36.891085 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:36.890984    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:36.990789 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:36.990753    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:38.642399 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:38.642357    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:05:41.357848 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.357820    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:05:41.506212 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506174    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99721c65-521b-439c-ad79-68f87f3528a1-istiod-ca-cert\") pod \"99721c65-521b-439c-ad79-68f87f3528a1\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") "
Aug 04 00:05:41.506212 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506216    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-data\") pod \"99721c65-521b-439c-ad79-68f87f3528a1\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") "
Aug 04 00:05:41.506462 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506280    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-certs\") pod \"99721c65-521b-439c-ad79-68f87f3528a1\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") "
Aug 04 00:05:41.506462 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506297    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-envoy\") pod \"99721c65-521b-439c-ad79-68f87f3528a1\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") "
Aug 04 00:05:41.506462 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506313    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99721c65-521b-439c-ad79-68f87f3528a1-istio-podinfo\") pod \"99721c65-521b-439c-ad79-68f87f3528a1\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") "
Aug 04 00:05:41.506462 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506377    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-istio-token\") pod \"99721c65-521b-439c-ad79-68f87f3528a1\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") "
Aug 04 00:05:41.506462 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506399    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-credential-socket\") pod \"99721c65-521b-439c-ad79-68f87f3528a1\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") "
Aug 04 00:05:41.506462 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506431    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-socket\") pod \"99721c65-521b-439c-ad79-68f87f3528a1\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") "
Aug 04 00:05:41.506462 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506459    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tl64s\" (UniqueName: \"kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-kube-api-access-tl64s\") pod \"99721c65-521b-439c-ad79-68f87f3528a1\" (UID: \"99721c65-521b-439c-ad79-68f87f3528a1\") "
Aug 04 00:05:41.506816 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506627    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99721c65-521b-439c-ad79-68f87f3528a1" (UID: "99721c65-521b-439c-ad79-68f87f3528a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:05:41.506816 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506618    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "99721c65-521b-439c-ad79-68f87f3528a1" (UID: "99721c65-521b-439c-ad79-68f87f3528a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:05:41.506816 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506692    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99721c65-521b-439c-ad79-68f87f3528a1" (UID: "99721c65-521b-439c-ad79-68f87f3528a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:05:41.506816 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506618    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99721c65-521b-439c-ad79-68f87f3528a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99721c65-521b-439c-ad79-68f87f3528a1" (UID: "99721c65-521b-439c-ad79-68f87f3528a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:05:41.506816 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506802    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:05:41.506983 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506817    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99721c65-521b-439c-ad79-68f87f3528a1" (UID: "99721c65-521b-439c-ad79-68f87f3528a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:05:41.506983 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506823    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99721c65-521b-439c-ad79-68f87f3528a1-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:05:41.506983 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506840    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:05:41.506983 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.506851    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:05:41.508697 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.508665    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99721c65-521b-439c-ad79-68f87f3528a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99721c65-521b-439c-ad79-68f87f3528a1" (UID: "99721c65-521b-439c-ad79-68f87f3528a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:05:41.508827 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.508763    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99721c65-521b-439c-ad79-68f87f3528a1" (UID: "99721c65-521b-439c-ad79-68f87f3528a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:05:41.508827 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.508807    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-kube-api-access-tl64s" (OuterVolumeSpecName: "kube-api-access-tl64s") pod "99721c65-521b-439c-ad79-68f87f3528a1" (UID: "99721c65-521b-439c-ad79-68f87f3528a1"). InnerVolumeSpecName "kube-api-access-tl64s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:05:41.508908 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.508845    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "99721c65-521b-439c-ad79-68f87f3528a1" (UID: "99721c65-521b-439c-ad79-68f87f3528a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:05:41.607811 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.607771    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:05:41.607811 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.607803    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99721c65-521b-439c-ad79-68f87f3528a1-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:05:41.607811 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.607817    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:05:41.608054 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.607828    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99721c65-521b-439c-ad79-68f87f3528a1-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:05:41.608054 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:41.607846    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tl64s\" (UniqueName: \"kubernetes.io/projected/99721c65-521b-439c-ad79-68f87f3528a1-kube-api-access-tl64s\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:05:42.021310 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.021242    2568 generic.go:356] "Generic (PLEG): container finished" podID="99721c65-521b-439c-ad79-68f87f3528a1" containerID="04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f" exitCode=0
Aug 04 00:05:42.021310 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.021314    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"
Aug 04 00:05:42.021630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.021313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" event={"ID":"99721c65-521b-439c-ad79-68f87f3528a1","Type":"ContainerDied","Data":"04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f"}
Aug 04 00:05:42.021630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.021388    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5" event={"ID":"99721c65-521b-439c-ad79-68f87f3528a1","Type":"ContainerDied","Data":"f16684cbd450fd046c2c9f551aa5fe2235bc8b7eb962e22eee4675005b1fd117"}
Aug 04 00:05:42.021630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.021421    2568 scope.go:117] "RemoveContainer" containerID="04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f"
Aug 04 00:05:42.029993 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.029972    2568 scope.go:117] "RemoveContainer" containerID="714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029"
Aug 04 00:05:42.038324 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.038300    2568 scope.go:117] "RemoveContainer" containerID="04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f"
Aug 04 00:05:42.038624 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:05:42.038603    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f\": container with ID starting with 04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f not found: ID does not exist" containerID="04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f"
Aug 04 00:05:42.038701 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.038634    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f"} err="failed to get container status \"04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f\": rpc error: code = NotFound desc = could not find container \"04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f\": container with ID starting with 04c0ceebea34bd997d1672ff1fbd94bd6eb2be51c2c43a24e973195e19c7016f not found: ID does not exist"
Aug 04 00:05:42.038701 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.038651    2568 scope.go:117] "RemoveContainer" containerID="714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029"
Aug 04 00:05:42.038904 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:05:42.038882    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029\": container with ID starting with 714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029 not found: ID does not exist" containerID="714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029"
Aug 04 00:05:42.038963 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.038910    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029"} err="failed to get container status \"714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029\": rpc error: code = NotFound desc = could not find container \"714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029\": container with ID starting with 714e17357dde8d72f9f8a8a26c6a24d18033450d6f1c64ed2363baa5336dc029 not found: ID does not exist"
Aug 04 00:05:42.038963 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.038940    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"]
Aug 04 00:05:42.042062 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:42.042039    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7b45e0cc-openshift-default-7d756b7dc6-9s8r5"]
Aug 04 00:05:43.659605 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:43.659573    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99721c65-521b-439c-ad79-68f87f3528a1" path="/var/lib/kubelet/pods/99721c65-521b-439c-ad79-68f87f3528a1/volumes"
Aug 04 00:05:48.590635 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:48.590596    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:51.346697 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:51.346616    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:05:55.121577 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:55.121533    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:55.228002 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:55.227967    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:55.325845 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:55.325807    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:55.437985 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:55.437889    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:05:55.839028 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:05:55.838995    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:06:21.782161 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:06:21.782120    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:06:27.972533 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:06:27.972495    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:06:28.036023 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:06:28.035986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:06:28.111704 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:06:28.111670    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:06:28.209703 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:06:28.209668    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:06:44.013914 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:06:44.013866    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:06:46.986115 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:06:46.986084    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:06:50.040108 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:06:50.040056    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:06:50.140778 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:06:50.140736    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:00.603055 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:00.603018    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:02.711985 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:02.711947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:11.603676 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:11.603633    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:17.509820 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:17.509784    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:17.613693 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:17.613658    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:17.710960 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:17.710914    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:17.810211 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:17.810111    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:18.424503 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:18.424458    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:18.520819 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:18.520777    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:18.620731 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:18.620692    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:19.666926 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:19.666885    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:07:20.094989 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:20.094944    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:26.345707 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:26.345643    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:26.446100 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:26.446064    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:26.989222 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:26.989185    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:29.440386 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:29.440349    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:07:33.332546 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.332501    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:33.433905 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.433859    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:33.553193 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.553148    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:33.840394 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840364    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"]
Aug 04 00:07:33.840739 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840717    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy"
Aug 04 00:07:33.840739 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840736    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy"
Aug 04 00:07:33.840739 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840751    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy"
Aug 04 00:07:33.840739 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840759    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy"
Aug 04 00:07:33.841039 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840800    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy"
Aug 04 00:07:33.841039 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840809    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a78c61e1-2a74-48ca-ba40-b8857dfc22d2" containerName="istio-proxy"
Aug 04 00:07:33.841039 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840872    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy"
Aug 04 00:07:33.841039 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840879    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy"
Aug 04 00:07:33.841039 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840887    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy"
Aug 04 00:07:33.841039 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.840893    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy"
Aug 04 00:07:33.843483 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.843465    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:33.845769 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.845741    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2c79f557-openshift-default-dockercfg-5hjzb\""
Aug 04 00:07:33.859919 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.859892    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"]
Aug 04 00:07:33.872388 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.872353    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:33.973740 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.973696    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt2zl\" (UniqueName: \"kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-kube-api-access-gt2zl\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:33.974075 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.974055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-token\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:33.974287 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.974237    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istiod-ca-cert\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:33.974474 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.974457    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-credential-socket\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:33.974614 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.974600    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-podinfo\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:33.974754 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.974740    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-socket\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:33.974882 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.974868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-envoy\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:33.975029 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.975015    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-certs\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:33.975188 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:33.975174    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-data\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.076479 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.076435    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-token\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.076683 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.076500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istiod-ca-cert\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.076683 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.076546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-credential-socket\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.076683 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.076576    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-podinfo\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.076683 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.076612    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-socket\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.076683 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.076645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-envoy\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.076683 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.076683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-certs\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.076998 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.076744    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-data\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.076998 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.076789    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt2zl\" (UniqueName: \"kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-kube-api-access-gt2zl\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.077103 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.077052    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-credential-socket\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.077239 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.077217    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-data\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.077307 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.077243    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-socket\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.077353 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.077308    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-certs\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.077353 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.077324    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istiod-ca-cert\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.079317 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.079295    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-envoy\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.079542 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.079525    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-podinfo\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.084708 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.084681    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-token\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.084827 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.084793    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt2zl\" (UniqueName: \"kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-kube-api-access-gt2zl\") pod \"e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") " pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.155874 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.155774    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:34.247280 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.247224    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:34.316696 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.316650    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"]
Aug 04 00:07:34.322175 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:07:34.322134    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5284b4_67ed_4044_9d0d_61c359b48cd8.slice/crio-460680fc0a2193db5a1c43b7197ea844104b592a4d4d99a9608f126ecbb7e3d7 WatchSource:0}: Error finding container 460680fc0a2193db5a1c43b7197ea844104b592a4d4d99a9608f126ecbb7e3d7: Status 404 returned error can't find the container with id 460680fc0a2193db5a1c43b7197ea844104b592a4d4d99a9608f126ecbb7e3d7
Aug 04 00:07:34.324685 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.324646    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:07:34.324798 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.324746    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:07:34.324863 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.324794    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:07:34.566647 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.566609    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" event={"ID":"4f5284b4-67ed-4044-9d0d-61c359b48cd8","Type":"ContainerStarted","Data":"a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd"}
Aug 04 00:07:34.567076 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.566678    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" event={"ID":"4f5284b4-67ed-4044-9d0d-61c359b48cd8","Type":"ContainerStarted","Data":"460680fc0a2193db5a1c43b7197ea844104b592a4d4d99a9608f126ecbb7e3d7"}
Aug 04 00:07:34.584355 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:34.584279    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" podStartSLOduration=1.584240606 podStartE2EDuration="1.584240606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:07:34.583644382 +0000 UTC m=+2255.469972867" watchObservedRunningTime="2026-08-04 00:07:34.584240606 +0000 UTC m=+2255.470569074"
Aug 04 00:07:35.156337 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:35.156302    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:35.161224 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:35.161195    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:35.571792 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:35.571756    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:35.572664 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:35.572648    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:36.512412 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:36.512376    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:36.613134 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:36.613099    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:37.638193 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:37.638150    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:38.025003 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:38.024970    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:38.132313 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:38.132270    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:38.228555 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:38.228494    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:41.051190 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:41.051157    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:07:50.573428 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:50.573329    2568 patch_prober.go:28] interesting pod/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:07:50.573428 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:50.573399    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:07:50.653032 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:50.652997    2568 generic.go:356] "Generic (PLEG): container finished" podID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerID="a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd" exitCode=0
Aug 04 00:07:50.653204 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:50.653071    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" event={"ID":"4f5284b4-67ed-4044-9d0d-61c359b48cd8","Type":"ContainerDied","Data":"a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd"}
Aug 04 00:07:50.653599 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:50.653579    2568 scope.go:117] "RemoveContainer" containerID="a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd"
Aug 04 00:07:50.654622 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:50.654590    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:07:50.654682 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:50.654671    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:07:50.654730 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:50.654713    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:07:51.660151 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:51.660106    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" event={"ID":"4f5284b4-67ed-4044-9d0d-61c359b48cd8","Type":"ContainerStarted","Data":"0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b"}
Aug 04 00:07:52.156193 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:52.156150    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:52.156405 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:52.156388    2568 patch_prober.go:28] interesting pod/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:07:52.156456 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:52.156434    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:07:53.156243 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:53.156207    2568 patch_prober.go:28] interesting pod/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:07:53.156653 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:53.156287    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:07:54.156732 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:54.156692    2568 patch_prober.go:28] interesting pod/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:07:54.157158 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:54.156755    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:07:55.156543 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:55.156504    2568 patch_prober.go:28] interesting pod/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:07:55.156723 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:55.156560    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:07:56.156990 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:56.156944    2568 patch_prober.go:28] interesting pod/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:07:56.157483 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:56.157032    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:07:57.128380 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:57.128333    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:07:57.160411 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:57.160378    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:57.160845 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:57.160769    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:07:57.161393 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:07:57.161374    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:08:01.485496 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:01.485441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:02.110553 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:02.110507    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:02.213742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:02.213704    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:02.524506 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:02.524445    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:08.530336 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:08.530299    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:08.630448 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:08.630407    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:19.482035 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:19.481997    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:19.576198 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:19.576164    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:19.684324 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:19.684254    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:19.774460 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:19.774374    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:20.068442 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:20.068348    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:21.451909 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:21.451866    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:08:25.791450 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:25.791409    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:25.890947 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:25.890912    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:26.028860 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:26.028820    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"]
Aug 04 00:08:26.029108 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:26.029082    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy" containerID="cri-o://0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b" gracePeriod=30
Aug 04 00:08:26.051005 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:26.050857    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:26.271819 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:26.271777    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:26.377195 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:26.377101    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:26.474221 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:26.474179    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:26.574825 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:26.574788    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:27.163908 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:27.163869    2568 patch_prober.go:28] interesting pod/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 00:08:27.164376 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:27.163946    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:08:31.275545 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.275519    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:08:31.370701 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.370603    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-data\") pod \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") "
Aug 04 00:08:31.370701 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.370661    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-envoy\") pod \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") "
Aug 04 00:08:31.370701 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.370704    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-podinfo\") pod \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") "
Aug 04 00:08:31.370986 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.370734    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-credential-socket\") pod \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") "
Aug 04 00:08:31.370986 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.370767    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istiod-ca-cert\") pod \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") "
Aug 04 00:08:31.370986 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.370808    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt2zl\" (UniqueName: \"kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-kube-api-access-gt2zl\") pod \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") "
Aug 04 00:08:31.370986 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.370865    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-certs\") pod \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") "
Aug 04 00:08:31.370986 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.370912    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-socket\") pod \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") "
Aug 04 00:08:31.370986 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.370915    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f5284b4-67ed-4044-9d0d-61c359b48cd8" (UID: "4f5284b4-67ed-4044-9d0d-61c359b48cd8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:08:31.370986 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.370940    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-token\") pod \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\" (UID: \"4f5284b4-67ed-4044-9d0d-61c359b48cd8\") "
Aug 04 00:08:31.371381 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.371046    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f5284b4-67ed-4044-9d0d-61c359b48cd8" (UID: "4f5284b4-67ed-4044-9d0d-61c359b48cd8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:08:31.371381 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.371130    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f5284b4-67ed-4044-9d0d-61c359b48cd8" (UID: "4f5284b4-67ed-4044-9d0d-61c359b48cd8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:08:31.371381 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.371247    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f5284b4-67ed-4044-9d0d-61c359b48cd8" (UID: "4f5284b4-67ed-4044-9d0d-61c359b48cd8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:08:31.371381 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.371343    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:08:31.371381 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.371363    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:08:31.371381 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.371377    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:08:31.371664 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.371381    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f5284b4-67ed-4044-9d0d-61c359b48cd8" (UID: "4f5284b4-67ed-4044-9d0d-61c359b48cd8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:08:31.373207 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.373175    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f5284b4-67ed-4044-9d0d-61c359b48cd8" (UID: "4f5284b4-67ed-4044-9d0d-61c359b48cd8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:08:31.373451 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.373325    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-kube-api-access-gt2zl" (OuterVolumeSpecName: "kube-api-access-gt2zl") pod "4f5284b4-67ed-4044-9d0d-61c359b48cd8" (UID: "4f5284b4-67ed-4044-9d0d-61c359b48cd8"). InnerVolumeSpecName "kube-api-access-gt2zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:08:31.373523 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.373461    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f5284b4-67ed-4044-9d0d-61c359b48cd8" (UID: "4f5284b4-67ed-4044-9d0d-61c359b48cd8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:08:31.373523 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.373481    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f5284b4-67ed-4044-9d0d-61c359b48cd8" (UID: "4f5284b4-67ed-4044-9d0d-61c359b48cd8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:08:31.472076 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.472039    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:08:31.472076 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.472069    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:08:31.472076 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.472078    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:08:31.472076 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.472088    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:08:31.472434 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.472096    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f5284b4-67ed-4044-9d0d-61c359b48cd8-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:08:31.472434 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.472105    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt2zl\" (UniqueName: \"kubernetes.io/projected/4f5284b4-67ed-4044-9d0d-61c359b48cd8-kube-api-access-gt2zl\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:08:31.849959 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.849920    2568 generic.go:356] "Generic (PLEG): container finished" podID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerID="0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b" exitCode=0
Aug 04 00:08:31.850127 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.849978    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"
Aug 04 00:08:31.850127 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.850006    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" event={"ID":"4f5284b4-67ed-4044-9d0d-61c359b48cd8","Type":"ContainerDied","Data":"0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b"}
Aug 04 00:08:31.850127 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.850064    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9" event={"ID":"4f5284b4-67ed-4044-9d0d-61c359b48cd8","Type":"ContainerDied","Data":"460680fc0a2193db5a1c43b7197ea844104b592a4d4d99a9608f126ecbb7e3d7"}
Aug 04 00:08:31.850127 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.850086    2568 scope.go:117] "RemoveContainer" containerID="0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b"
Aug 04 00:08:31.860777 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.860754    2568 scope.go:117] "RemoveContainer" containerID="a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd"
Aug 04 00:08:31.869205 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.869188    2568 scope.go:117] "RemoveContainer" containerID="0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b"
Aug 04 00:08:31.869344 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.869325    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"]
Aug 04 00:08:31.869553 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:08:31.869535    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b\": container with ID starting with 0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b not found: ID does not exist" containerID="0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b"
Aug 04 00:08:31.869609 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.869563    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b"} err="failed to get container status \"0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b\": rpc error: code = NotFound desc = could not find container \"0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b\": container with ID starting with 0fb1675b895ab5423240f5afa05ad1e636604cc8d436a0f6e34de2ac3969399b not found: ID does not exist"
Aug 04 00:08:31.869609 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.869581    2568 scope.go:117] "RemoveContainer" containerID="a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd"
Aug 04 00:08:31.869813 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:08:31.869796    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd\": container with ID starting with a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd not found: ID does not exist" containerID="a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd"
Aug 04 00:08:31.869855 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.869820    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd"} err="failed to get container status \"a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd\": rpc error: code = NotFound desc = could not find container \"a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd\": container with ID starting with a597f9baa6cc277b39d38dd26f7217ec6dcc8d83f8f7dbaff97a451572f8d9fd not found: ID does not exist"
Aug 04 00:08:31.873211 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:31.873186    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2c79f557-openshift-default-56864f85b4-nm6c9"]
Aug 04 00:08:32.452137 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:32.452094    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:32.553310 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:32.553244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:32.652035 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:32.651999    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:32.790086 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:32.790053    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:33.659789 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:33.659752    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" path="/var/lib/kubelet/pods/4f5284b4-67ed-4044-9d0d-61c359b48cd8/volumes"
Aug 04 00:08:38.736791 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:38.736750    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:08:38.835007 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:08:38.834967    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:09:00.744079 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:00.744043    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:09:06.990159 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:06.990120    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"]
Aug 04 00:09:06.990691 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:06.990375    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k" podUID="ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496" containerName="manager" containerID="cri-o://df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033" gracePeriod=10
Aug 04 00:09:07.251832 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:07.251767    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 04 00:09:07.403273 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:07.403241    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddffs\" (UniqueName: \"kubernetes.io/projected/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-kube-api-access-ddffs\") pod \"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496\" (UID: \"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496\") "
Aug 04 00:09:07.403477 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:07.403356    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-extensions-socket-volume\") pod \"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496\" (UID: \"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496\") "
Aug 04 00:09:07.403747 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:07.403723    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496" (UID: "ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:09:07.405498 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:07.405476    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-kube-api-access-ddffs" (OuterVolumeSpecName: "kube-api-access-ddffs") pod "ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496" (UID: "ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496"). InnerVolumeSpecName "kube-api-access-ddffs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:09:07.504192 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:07.504103    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-extensions-socket-volume\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:09:07.504192 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:07.504136    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddffs\" (UniqueName: \"kubernetes.io/projected/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496-kube-api-access-ddffs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:09:08.024729 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:08.024696    2568 generic.go:356] "Generic (PLEG): container finished" podID="ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496" containerID="df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033" exitCode=0
Aug 04 00:09:08.025439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:08.024744    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"
Aug 04 00:09:08.025439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:08.024758    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k" event={"ID":"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496","Type":"ContainerDied","Data":"df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033"}
Aug 04 00:09:08.025439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:08.024802    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k" event={"ID":"ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496","Type":"ContainerDied","Data":"48fda02627804bbd461f5fc55f3dcf0050ca16165ef92427416b5f8f2b423f76"}
Aug 04 00:09:08.025439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:08.024824    2568 scope.go:117] "RemoveContainer" containerID="df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033"
Aug 04 00:09:08.035111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:08.035088    2568 scope.go:117] "RemoveContainer" containerID="df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033"
Aug 04 00:09:08.035406 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:09:08.035383    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033\": container with ID starting with df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033 not found: ID does not exist" containerID="df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033"
Aug 04 00:09:08.035473 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:08.035416    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033"} err="failed to get container status \"df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033\": rpc error: code = NotFound desc = could not find container \"df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033\": container with ID starting with df5be1eff07a181c0d19ceea6aaacd74923aaf6a8af1784739275515804c0033 not found: ID does not exist"
Aug 04 00:09:08.041175 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:08.041152    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"]
Aug 04 00:09:08.044730 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:08.044710    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mv84k"]
Aug 04 00:09:09.659624 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:09:09.659590    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496" path="/var/lib/kubelet/pods/ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496/volumes"
Aug 04 00:10:22.596848 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.596768    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"]
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597084    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597095    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="99721c65-521b-439c-ad79-68f87f3528a1" containerName="istio-proxy"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597103    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597110    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf3607a-c248-4848-aa07-562b03d02585" containerName="istio-proxy"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597124    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597130    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597142    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496" containerName="manager"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597148    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496" containerName="manager"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597154    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597159    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597220    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2957e8-5ffe-4e05-bc55-a7ce1b5ad496" containerName="manager"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597229    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy"
Aug 04 00:10:22.597330 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.597235    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f5284b4-67ed-4044-9d0d-61c359b48cd8" containerName="istio-proxy"
Aug 04 00:10:22.599344 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.599327    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"
Aug 04 00:10:22.601693 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.601659    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-q9ssh\""
Aug 04 00:10:22.613099 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.613070    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"]
Aug 04 00:10:22.635570 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.635536    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz2jt\" (UniqueName: \"kubernetes.io/projected/9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18-kube-api-access-pz2jt\") pod \"kuadrant-operator-controller-manager-68cf589589-k8hv9\" (UID: \"9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"
Aug 04 00:10:22.635736 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.635623    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-k8hv9\" (UID: \"9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"
Aug 04 00:10:22.736834 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.736795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-k8hv9\" (UID: \"9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"
Aug 04 00:10:22.737029 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.736943    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz2jt\" (UniqueName: \"kubernetes.io/projected/9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18-kube-api-access-pz2jt\") pod \"kuadrant-operator-controller-manager-68cf589589-k8hv9\" (UID: \"9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"
Aug 04 00:10:22.737244 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.737220    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-k8hv9\" (UID: \"9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"
Aug 04 00:10:22.746028 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.746004    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz2jt\" (UniqueName: \"kubernetes.io/projected/9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18-kube-api-access-pz2jt\") pod \"kuadrant-operator-controller-manager-68cf589589-k8hv9\" (UID: \"9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"
Aug 04 00:10:22.910430 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:22.910340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"
Aug 04 00:10:23.055748 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:23.055717    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"]
Aug 04 00:10:23.058662 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:10:23.058630    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f17211a_5f8d_45fa_8cbc_e8f87f5d2e18.slice/crio-f945c15b27249b0e80de7c9e96dadaf8bef4d915a23a302575db3460325d3102 WatchSource:0}: Error finding container f945c15b27249b0e80de7c9e96dadaf8bef4d915a23a302575db3460325d3102: Status 404 returned error can't find the container with id f945c15b27249b0e80de7c9e96dadaf8bef4d915a23a302575db3460325d3102
Aug 04 00:10:23.367106 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:23.367065    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9" event={"ID":"9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18","Type":"ContainerStarted","Data":"94dbcff75d68fafe92a0df7276dcab2206e5be4b674ef932795786e5c9ae0b46"}
Aug 04 00:10:23.367320 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:23.367133    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9" event={"ID":"9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18","Type":"ContainerStarted","Data":"f945c15b27249b0e80de7c9e96dadaf8bef4d915a23a302575db3460325d3102"}
Aug 04 00:10:23.367320 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:23.367183    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"
Aug 04 00:10:23.388482 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:23.388429    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9" podStartSLOduration=1.3884142289999999 podStartE2EDuration="1.388414229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:10:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:10:23.386077042 +0000 UTC m=+2424.272405507" watchObservedRunningTime="2026-08-04 00:10:23.388414229 +0000 UTC m=+2424.274742694"
Aug 04 00:10:24.993072 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:24.993027    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:10:34.374178 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:34.374145    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k8hv9"
Aug 04 00:10:40.881137 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:40.881089    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:10:41.164815 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.164732    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"]
Aug 04 00:10:41.167101 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.167069    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.169461 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.169437    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-335654eb-openshift-default-dockercfg-fq25k\""
Aug 04 00:10:41.179332 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.179303    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"]
Aug 04 00:10:41.220516 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.220484    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:10:41.309026 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.308977    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf7706b-e385-487a-b089-f2185ae0531c-istiod-ca-cert\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.309026 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.309032    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-socket\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.309245 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.309055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf7706b-e385-487a-b089-f2185ae0531c-istio-podinfo\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.309245 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.309099    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghdw\" (UniqueName: \"kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-kube-api-access-vghdw\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.309245 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.309133    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-certs\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.309245 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.309207    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-data\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.309245 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.309227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-istio-token\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.309467 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.309323    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-credential-socket\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.309467 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.309348    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-envoy\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410280 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf7706b-e385-487a-b089-f2185ae0531c-istio-podinfo\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410280 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410271    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghdw\" (UniqueName: \"kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-kube-api-access-vghdw\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410497 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410390    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-certs\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410497 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-data\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410566    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-istio-token\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410721 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410703    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-credential-socket\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410779 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410729    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-envoy\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410779 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410749    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf7706b-e385-487a-b089-f2185ae0531c-istiod-ca-cert\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410779 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410768    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-data\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410922 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410785    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-certs\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.410922 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.410817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-socket\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.411196 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.411004    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-credential-socket\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.411196 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.411065    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-socket\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.411350 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.411302    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf7706b-e385-487a-b089-f2185ae0531c-istiod-ca-cert\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.412981 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.412955    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-envoy\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.413115 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.413046    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf7706b-e385-487a-b089-f2185ae0531c-istio-podinfo\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.420314 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.420199    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-istio-token\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.420314 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.420288    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghdw\" (UniqueName: \"kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-kube-api-access-vghdw\") pod \"e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") " pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.478363 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.478328    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:41.504614 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.504582    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:10:41.618291 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.618246    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"]
Aug 04 00:10:41.620242 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:10:41.620204    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf7706b_e385_487a_b089_f2185ae0531c.slice/crio-bb4d554a1c249d086423c7ebe8bd7c30840dab35e5af0dbbcb8676655b98c4e8 WatchSource:0}: Error finding container bb4d554a1c249d086423c7ebe8bd7c30840dab35e5af0dbbcb8676655b98c4e8: Status 404 returned error can't find the container with id bb4d554a1c249d086423c7ebe8bd7c30840dab35e5af0dbbcb8676655b98c4e8
Aug 04 00:10:41.622395 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.622354    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:10:41.622503 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.622444    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:10:41.622503 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:41.622491    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:10:42.454554 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:42.454519    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" event={"ID":"4bf7706b-e385-487a-b089-f2185ae0531c","Type":"ContainerStarted","Data":"d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0"}
Aug 04 00:10:42.454979 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:42.454570    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" event={"ID":"4bf7706b-e385-487a-b089-f2185ae0531c","Type":"ContainerStarted","Data":"bb4d554a1c249d086423c7ebe8bd7c30840dab35e5af0dbbcb8676655b98c4e8"}
Aug 04 00:10:42.473692 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:42.473642    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" podStartSLOduration=1.473625513 podStartE2EDuration="1.473625513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:10:42.472126422 +0000 UTC m=+2443.358454888" watchObservedRunningTime="2026-08-04 00:10:42.473625513 +0000 UTC m=+2443.359953977"
Aug 04 00:10:42.479201 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:42.479175    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:42.484421 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:42.484397    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:42.948151 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:42.948113    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:10:43.459200 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:43.459166    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:43.460360 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:43.460338    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:10:44.481835 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:44.481803    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:10:44.585463 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:44.585425    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:10:45.549748 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:45.549706    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:10:45.818177 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:45.818017    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:10:46.077196 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:46.077086    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:10:46.174043 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:46.173994    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:10:53.060188 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:53.060147    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:10:58.461333 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:58.461213    2568 patch_prober.go:28] interesting pod/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 04 00:10:58.461333 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:58.461306    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 04 00:10:58.544302 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:58.544197    2568 generic.go:356] "Generic (PLEG): container finished" podID="4bf7706b-e385-487a-b089-f2185ae0531c" containerID="d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0" exitCode=0
Aug 04 00:10:58.544302 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:58.544282    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" event={"ID":"4bf7706b-e385-487a-b089-f2185ae0531c","Type":"ContainerDied","Data":"d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0"}
Aug 04 00:10:58.544665 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:58.544651    2568 scope.go:117] "RemoveContainer" containerID="d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0"
Aug 04 00:10:58.545710 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:58.545676    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:10:58.545782 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:58.545767    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:10:58.545819 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:58.545805    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:10:59.551980 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:10:59.551948    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" event={"ID":"4bf7706b-e385-487a-b089-f2185ae0531c","Type":"ContainerStarted","Data":"e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b"}
Aug 04 00:11:00.479003 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:00.478962    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:11:00.479197 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:00.479166    2568 patch_prober.go:28] interesting pod/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 04 00:11:00.479248 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:00.479230    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 04 00:11:01.479289 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:01.479228    2568 patch_prober.go:28] interesting pod/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 04 00:11:01.479715 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:01.479305    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 04 00:11:02.479113 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:02.479075    2568 patch_prober.go:28] interesting pod/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 04 00:11:02.479342 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:02.479134    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 04 00:11:03.479239 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:03.479198    2568 patch_prober.go:28] interesting pod/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 04 00:11:03.479452 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:03.479309    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 04 00:11:04.479463 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:04.479422    2568 patch_prober.go:28] interesting pod/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 04 00:11:04.479956 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:04.479502    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 04 00:11:05.483647 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:05.483617    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:11:05.484111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:05.483912    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:11:05.484517 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:05.484500    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:11:09.380912 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:09.380881    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:11:25.084089 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.084053    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"]
Aug 04 00:11:25.089485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.089453    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.092050 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.092028    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-335654eb\"/\"kube-root-ca.crt\""
Aug 04 00:11:25.092292 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.092244    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-335654eb\"/\"default-dockercfg-l7fjk\""
Aug 04 00:11:25.093211 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.093188    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-335654eb\"/\"openshift-service-ca.crt\""
Aug 04 00:11:25.096740 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.096459    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-335654eb\"/\"e2e-lifecycle-model-335654eb-kserve-self-signed-certs\""
Aug 04 00:11:25.097762 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.097735    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"]
Aug 04 00:11:25.098951 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.098874    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:11:25.215589 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.215553    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-home\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.215589 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.215593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-dshm\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.215816 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.215608    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-model-cache\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.215816 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.215711    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb5c371-6089-4bde-872c-550afc427fcb-tls-certs\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.215816 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.215741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-tmp-dir\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.215816 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.215761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghlrj\" (UniqueName: \"kubernetes.io/projected/eeb5c371-6089-4bde-872c-550afc427fcb-kube-api-access-ghlrj\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.316647 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.316610    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-home\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.316647 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.316651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-dshm\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.316935 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.316669    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-model-cache\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.316935 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.316723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb5c371-6089-4bde-872c-550afc427fcb-tls-certs\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.316935 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.316748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-tmp-dir\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.316935 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.316772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlrj\" (UniqueName: \"kubernetes.io/projected/eeb5c371-6089-4bde-872c-550afc427fcb-kube-api-access-ghlrj\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.317289 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.317232    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-model-cache\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.317521 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.317501    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-tmp-dir\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.317612 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.317531    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-home\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.320148 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.320122    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-dshm\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.320337 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.320318    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb5c371-6089-4bde-872c-550afc427fcb-tls-certs\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.325949 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.325921    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghlrj\" (UniqueName: \"kubernetes.io/projected/eeb5c371-6089-4bde-872c-550afc427fcb-kube-api-access-ghlrj\") pod \"e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") " pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.401938 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.401828    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:25.555160 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.555132    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"]
Aug 04 00:11:25.557994 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:11:25.557966    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeeb5c371_6089_4bde_872c_550afc427fcb.slice/crio-235a544410e4d5f7540f22fb6a939caa1afe408075c532abc776e8d9a7306597 WatchSource:0}: Error finding container 235a544410e4d5f7540f22fb6a939caa1afe408075c532abc776e8d9a7306597: Status 404 returned error can't find the container with id 235a544410e4d5f7540f22fb6a939caa1afe408075c532abc776e8d9a7306597
Aug 04 00:11:25.670805 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.670724    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz" event={"ID":"eeb5c371-6089-4bde-872c-550afc427fcb","Type":"ContainerStarted","Data":"ba6c9bc69550e5470d673b369a4b5a69dafc49d65e82ba5927a3a25c78a5f18a"}
Aug 04 00:11:25.670805 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.670763    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz" event={"ID":"eeb5c371-6089-4bde-872c-550afc427fcb","Type":"ContainerStarted","Data":"235a544410e4d5f7540f22fb6a939caa1afe408075c532abc776e8d9a7306597"}
Aug 04 00:11:25.689570 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:25.689516    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz" podStartSLOduration=0.689499859 podStartE2EDuration="689.499859ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:11:25.687623223 +0000 UTC m=+2486.573951689" watchObservedRunningTime="2026-08-04 00:11:25.689499859 +0000 UTC m=+2486.575828324"
Aug 04 00:11:27.252832 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:27.252796    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:11:29.052362 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:29.052328    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:11:29.152969 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:29.152935    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:11:35.402539 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:35.402501    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:35.402959 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:35.402558    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:35.415118 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:35.415093    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:35.727587 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:35.727565    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:11:38.558289 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:11:38.558233    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:12:01.482353 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:01.482244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:01.957477 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:01.957378    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:12:04.503393 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:04.503360    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:04.587079 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:04.587046    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:04.643977 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:04.643943    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:04.703046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:04.703010    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:07.673529 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:07.673495    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:12:07.819249 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:07.819218    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:12.810252 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:12.810212    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"]
Aug 04 00:12:12.901038 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:12.901004    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:27.829777 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:27.829699    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz" podUID="eeb5c371-6089-4bde-872c-550afc427fcb" containerName="main" containerID="cri-o://ba6c9bc69550e5470d673b369a4b5a69dafc49d65e82ba5927a3a25c78a5f18a" gracePeriod=45
Aug 04 00:12:27.966108 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:27.966069    2568 generic.go:356] "Generic (PLEG): container finished" podID="eeb5c371-6089-4bde-872c-550afc427fcb" containerID="ba6c9bc69550e5470d673b369a4b5a69dafc49d65e82ba5927a3a25c78a5f18a" exitCode=0
Aug 04 00:12:27.966286 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:27.966146    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz" event={"ID":"eeb5c371-6089-4bde-872c-550afc427fcb","Type":"ContainerDied","Data":"ba6c9bc69550e5470d673b369a4b5a69dafc49d65e82ba5927a3a25c78a5f18a"}
Aug 04 00:12:28.083838 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.083772    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:12:28.168824 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.168772    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-home\") pod \"eeb5c371-6089-4bde-872c-550afc427fcb\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") "
Aug 04 00:12:28.169016 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.168866    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-dshm\") pod \"eeb5c371-6089-4bde-872c-550afc427fcb\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") "
Aug 04 00:12:28.169016 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.168901    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-model-cache\") pod \"eeb5c371-6089-4bde-872c-550afc427fcb\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") "
Aug 04 00:12:28.169016 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.168933    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-tmp-dir\") pod \"eeb5c371-6089-4bde-872c-550afc427fcb\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") "
Aug 04 00:12:28.169016 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.168987    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghlrj\" (UniqueName: \"kubernetes.io/projected/eeb5c371-6089-4bde-872c-550afc427fcb-kube-api-access-ghlrj\") pod \"eeb5c371-6089-4bde-872c-550afc427fcb\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") "
Aug 04 00:12:28.169239 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.169044    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-home" (OuterVolumeSpecName: "home") pod "eeb5c371-6089-4bde-872c-550afc427fcb" (UID: "eeb5c371-6089-4bde-872c-550afc427fcb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:12:28.169239 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.169051    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb5c371-6089-4bde-872c-550afc427fcb-tls-certs\") pod \"eeb5c371-6089-4bde-872c-550afc427fcb\" (UID: \"eeb5c371-6089-4bde-872c-550afc427fcb\") "
Aug 04 00:12:28.169239 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.169170    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-model-cache" (OuterVolumeSpecName: "model-cache") pod "eeb5c371-6089-4bde-872c-550afc427fcb" (UID: "eeb5c371-6089-4bde-872c-550afc427fcb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:12:28.169239 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.169224    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eeb5c371-6089-4bde-872c-550afc427fcb" (UID: "eeb5c371-6089-4bde-872c-550afc427fcb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:12:28.169469 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.169450    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-model-cache\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:12:28.169512 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.169477    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-tmp-dir\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:12:28.169512 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.169490    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-home\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:12:28.171276 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.171242    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb5c371-6089-4bde-872c-550afc427fcb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eeb5c371-6089-4bde-872c-550afc427fcb" (UID: "eeb5c371-6089-4bde-872c-550afc427fcb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:12:28.171369 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.171273    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-dshm" (OuterVolumeSpecName: "dshm") pod "eeb5c371-6089-4bde-872c-550afc427fcb" (UID: "eeb5c371-6089-4bde-872c-550afc427fcb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:12:28.171369 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.171350    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb5c371-6089-4bde-872c-550afc427fcb-kube-api-access-ghlrj" (OuterVolumeSpecName: "kube-api-access-ghlrj") pod "eeb5c371-6089-4bde-872c-550afc427fcb" (UID: "eeb5c371-6089-4bde-872c-550afc427fcb"). InnerVolumeSpecName "kube-api-access-ghlrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:12:28.270552 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.270514    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb5c371-6089-4bde-872c-550afc427fcb-dshm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:12:28.270552 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.270543    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghlrj\" (UniqueName: \"kubernetes.io/projected/eeb5c371-6089-4bde-872c-550afc427fcb-kube-api-access-ghlrj\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:12:28.270552 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.270555    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb5c371-6089-4bde-872c-550afc427fcb-tls-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:12:28.972085 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.972055    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"
Aug 04 00:12:28.972519 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.972061    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz" event={"ID":"eeb5c371-6089-4bde-872c-550afc427fcb","Type":"ContainerDied","Data":"235a544410e4d5f7540f22fb6a939caa1afe408075c532abc776e8d9a7306597"}
Aug 04 00:12:28.972519 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.972169    2568 scope.go:117] "RemoveContainer" containerID="ba6c9bc69550e5470d673b369a4b5a69dafc49d65e82ba5927a3a25c78a5f18a"
Aug 04 00:12:28.994159 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.994129    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"]
Aug 04 00:12:28.999370 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:28.999338    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-335654eb/e2e-lifecycle-model-335654eb-kserve-7475687c95-qllwz"]
Aug 04 00:12:29.660382 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:29.660346    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb5c371-6089-4bde-872c-550afc427fcb" path="/var/lib/kubelet/pods/eeb5c371-6089-4bde-872c-550afc427fcb/volumes"
Aug 04 00:12:49.762359 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:49.762320    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:50.677045 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:50.677008    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:56.577309 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:56.577251    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:56.643277 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:56.643231    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:56.848059 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:56.847964    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"]
Aug 04 00:12:56.848217 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:56.848178    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy" containerID="cri-o://e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b" gracePeriod=30
Aug 04 00:12:56.866776 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:56.866744    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:57.088123 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:57.088084    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:12:59.050387 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:12:59.050351    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:13:02.100601 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.100570    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:13:02.134409 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.134315    2568 generic.go:356] "Generic (PLEG): container finished" podID="4bf7706b-e385-487a-b089-f2185ae0531c" containerID="e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b" exitCode=0
Aug 04 00:13:02.134409 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.134369    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"
Aug 04 00:13:02.134409 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.134395    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" event={"ID":"4bf7706b-e385-487a-b089-f2185ae0531c","Type":"ContainerDied","Data":"e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b"}
Aug 04 00:13:02.134721 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.134455    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q" event={"ID":"4bf7706b-e385-487a-b089-f2185ae0531c","Type":"ContainerDied","Data":"bb4d554a1c249d086423c7ebe8bd7c30840dab35e5af0dbbcb8676655b98c4e8"}
Aug 04 00:13:02.134721 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.134486    2568 scope.go:117] "RemoveContainer" containerID="e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b"
Aug 04 00:13:02.143487 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.143469    2568 scope.go:117] "RemoveContainer" containerID="d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0"
Aug 04 00:13:02.151851 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.151827    2568 scope.go:117] "RemoveContainer" containerID="e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b"
Aug 04 00:13:02.152179 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:13:02.152147    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b\": container with ID starting with e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b not found: ID does not exist" containerID="e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b"
Aug 04 00:13:02.152334 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.152186    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b"} err="failed to get container status \"e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b\": rpc error: code = NotFound desc = could not find container \"e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b\": container with ID starting with e6d5eaabd9e3ebe477aa22dbf7cacb313561895ccdffaaea2b5a1584f7010d5b not found: ID does not exist"
Aug 04 00:13:02.152334 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.152205    2568 scope.go:117] "RemoveContainer" containerID="d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0"
Aug 04 00:13:02.152499 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:13:02.152480    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0\": container with ID starting with d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0 not found: ID does not exist" containerID="d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0"
Aug 04 00:13:02.152565 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.152504    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0"} err="failed to get container status \"d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0\": rpc error: code = NotFound desc = could not find container \"d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0\": container with ID starting with d73ea6a80bd1f056497aaf852d1b616f8a635d72a129bd3ba999c8b616c4cac0 not found: ID does not exist"
Aug 04 00:13:02.187991 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.187956    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf7706b-e385-487a-b089-f2185ae0531c-istio-podinfo\") pod \"4bf7706b-e385-487a-b089-f2185ae0531c\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") "
Aug 04 00:13:02.188163 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188002    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-envoy\") pod \"4bf7706b-e385-487a-b089-f2185ae0531c\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") "
Aug 04 00:13:02.188163 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188026    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vghdw\" (UniqueName: \"kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-kube-api-access-vghdw\") pod \"4bf7706b-e385-487a-b089-f2185ae0531c\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") "
Aug 04 00:13:02.188163 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188078    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-data\") pod \"4bf7706b-e385-487a-b089-f2185ae0531c\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") "
Aug 04 00:13:02.188163 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188105    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-credential-socket\") pod \"4bf7706b-e385-487a-b089-f2185ae0531c\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") "
Aug 04 00:13:02.188163 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188133    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-istio-token\") pod \"4bf7706b-e385-487a-b089-f2185ae0531c\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") "
Aug 04 00:13:02.188471 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188172    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-socket\") pod \"4bf7706b-e385-487a-b089-f2185ae0531c\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") "
Aug 04 00:13:02.188471 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188195    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-certs\") pod \"4bf7706b-e385-487a-b089-f2185ae0531c\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") "
Aug 04 00:13:02.188471 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188234    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf7706b-e385-487a-b089-f2185ae0531c-istiod-ca-cert\") pod \"4bf7706b-e385-487a-b089-f2185ae0531c\" (UID: \"4bf7706b-e385-487a-b089-f2185ae0531c\") "
Aug 04 00:13:02.188613 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188496    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4bf7706b-e385-487a-b089-f2185ae0531c" (UID: "4bf7706b-e385-487a-b089-f2185ae0531c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:13:02.188613 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188509    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-data" (OuterVolumeSpecName: "istio-data") pod "4bf7706b-e385-487a-b089-f2185ae0531c" (UID: "4bf7706b-e385-487a-b089-f2185ae0531c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:13:02.188613 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188529    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4bf7706b-e385-487a-b089-f2185ae0531c" (UID: "4bf7706b-e385-487a-b089-f2185ae0531c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:13:02.188780 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188727    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4bf7706b-e385-487a-b089-f2185ae0531c" (UID: "4bf7706b-e385-487a-b089-f2185ae0531c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:13:02.188970 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.188943    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bf7706b-e385-487a-b089-f2185ae0531c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4bf7706b-e385-487a-b089-f2185ae0531c" (UID: "4bf7706b-e385-487a-b089-f2185ae0531c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:13:02.189097 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.189047    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:13:02.189097 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.189066    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:13:02.189097 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.189074    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf7706b-e385-487a-b089-f2185ae0531c-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:13:02.189097 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.189082    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:13:02.189097 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.189090    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:13:02.190468 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.190434    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bf7706b-e385-487a-b089-f2185ae0531c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4bf7706b-e385-487a-b089-f2185ae0531c" (UID: "4bf7706b-e385-487a-b089-f2185ae0531c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:13:02.190594 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.190518    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4bf7706b-e385-487a-b089-f2185ae0531c" (UID: "4bf7706b-e385-487a-b089-f2185ae0531c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:13:02.190864 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.190848    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-kube-api-access-vghdw" (OuterVolumeSpecName: "kube-api-access-vghdw") pod "4bf7706b-e385-487a-b089-f2185ae0531c" (UID: "4bf7706b-e385-487a-b089-f2185ae0531c"). InnerVolumeSpecName "kube-api-access-vghdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:13:02.190943 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.190924    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-istio-token" (OuterVolumeSpecName: "istio-token") pod "4bf7706b-e385-487a-b089-f2185ae0531c" (UID: "4bf7706b-e385-487a-b089-f2185ae0531c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:13:02.289568 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.289528    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vghdw\" (UniqueName: \"kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-kube-api-access-vghdw\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:13:02.289568 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.289561    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf7706b-e385-487a-b089-f2185ae0531c-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:13:02.289568 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.289570    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf7706b-e385-487a-b089-f2185ae0531c-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:13:02.289568 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.289579    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf7706b-e385-487a-b089-f2185ae0531c-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:13:02.456491 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.456456    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"]
Aug 04 00:13:02.461085 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:02.461055    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-335654eb-openshift-default-8c8fb4564-8xk8q"]
Aug 04 00:13:03.659552 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:03.659516    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" path="/var/lib/kubelet/pods/4bf7706b-e385-487a-b089-f2185ae0531c/volumes"
Aug 04 00:13:08.356670 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:08.356627    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:08.455640 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:08.455594    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:08.555861 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:08.555824    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:09.156961 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:09.156928    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:09.257497 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:09.257459    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:09.359576 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:09.359544    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:10.579043 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:10.579005    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:11.043921 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:11.043883    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:13:17.042154 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:17.042117    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:17.142117 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:17.142084    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:17.709926 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:17.709882    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:19.641250 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:19.641210    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:13:24.464599 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:24.464566    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:24.565971 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:24.565932    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:24.665077 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:24.665035    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:35.152475 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:35.152437    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:35.376885 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:35.376850    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:44.972181 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:44.972141    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:13:56.320448 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:13:56.320394    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:02.266378 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:02.266341    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:02.410838 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:02.410804    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:02.480970 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:02.480930    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:02.749650 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:02.749619    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:03.028762 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.028682    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"]
Aug 04 00:14:03.029018 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.029006    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy"
Aug 04 00:14:03.029061 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.029020    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy"
Aug 04 00:14:03.029061 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.029033    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy"
Aug 04 00:14:03.029061 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.029040    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy"
Aug 04 00:14:03.029061 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.029047    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb5c371-6089-4bde-872c-550afc427fcb" containerName="main"
Aug 04 00:14:03.029061 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.029052    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb5c371-6089-4bde-872c-550afc427fcb" containerName="main"
Aug 04 00:14:03.029214 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.029116    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb5c371-6089-4bde-872c-550afc427fcb" containerName="main"
Aug 04 00:14:03.029214 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.029124    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy"
Aug 04 00:14:03.029214 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.029131    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bf7706b-e385-487a-b089-f2185ae0531c" containerName="istio-proxy"
Aug 04 00:14:03.033324 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.033305    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.035528 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.035506    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e43d99-openshift-default-dockercfg-hrxgr\""
Aug 04 00:14:03.042170 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.042141    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"]
Aug 04 00:14:03.046901 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.046874    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:03.144309 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.144240    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lqz6\" (UniqueName: \"kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-kube-api-access-7lqz6\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.144309 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.144314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-podinfo\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.144558 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.144336    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-credential-socket\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.144558 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.144351    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-certs\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.144558 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.144425    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b08dfb23-b942-42a9-a198-c4549013e7f4-istiod-ca-cert\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.144558 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.144448    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-socket\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.144558 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.144512    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-envoy\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.144558 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.144536    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-token\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.144764 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.144563    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-data\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.245647 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.245597    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b08dfb23-b942-42a9-a198-c4549013e7f4-istiod-ca-cert\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.245873 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.245655    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-socket\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.245873 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.245694    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-envoy\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.245873 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.245717    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-token\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.245873 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.245752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-data\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.245873 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.245785    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lqz6\" (UniqueName: \"kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-kube-api-access-7lqz6\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.245873 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.245819    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-podinfo\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.245873 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.245848    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-credential-socket\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.246245 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.245872    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-certs\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.246245 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.246142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-data\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.246410 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.246324    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-credential-socket\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.246410 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.246378    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-certs\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.246494 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.246412    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b08dfb23-b942-42a9-a198-c4549013e7f4-istiod-ca-cert\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.246535 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.246509    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-socket\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.248339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.248322    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-envoy\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.248474 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.248456    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-podinfo\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.253781 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.253752    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-token\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.253936 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.253921    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lqz6\" (UniqueName: \"kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-kube-api-access-7lqz6\") pod \"e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") " pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.344719 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.344631    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:03.426822 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.426787    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:03.484779 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.484738    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"]
Aug 04 00:14:03.488228 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:14:03.488193    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08dfb23_b942_42a9_a198_c4549013e7f4.slice/crio-ab37c692416f78d0b3523429aa43b6076bd8c642d90fd82d0d3ed31933be3991 WatchSource:0}: Error finding container ab37c692416f78d0b3523429aa43b6076bd8c642d90fd82d0d3ed31933be3991: Status 404 returned error can't find the container with id ab37c692416f78d0b3523429aa43b6076bd8c642d90fd82d0d3ed31933be3991
Aug 04 00:14:03.490334 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.490297    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:03.490452 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.490382    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:03.490452 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:03.490432    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:04.440521 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:04.440484    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" event={"ID":"b08dfb23-b942-42a9-a198-c4549013e7f4","Type":"ContainerStarted","Data":"137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056"}
Aug 04 00:14:04.440947 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:04.440540    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" event={"ID":"b08dfb23-b942-42a9-a198-c4549013e7f4","Type":"ContainerStarted","Data":"ab37c692416f78d0b3523429aa43b6076bd8c642d90fd82d0d3ed31933be3991"}
Aug 04 00:14:04.460077 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:04.460022    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" podStartSLOduration=1.460007851 podStartE2EDuration="1.460007851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:14:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:14:04.45817771 +0000 UTC m=+2645.344506219" watchObservedRunningTime="2026-08-04 00:14:04.460007851 +0000 UTC m=+2645.346336380"
Aug 04 00:14:05.345596 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:05.345560    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:05.350354 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:05.350325    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:05.446142 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:05.446112    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:05.447091 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:05.447070    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:06.378096 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:06.378062    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:06.479033 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:06.478987    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:07.506493 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:07.506458    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:07.606437 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:07.606362    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:08.083384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:08.083347    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:08.183471 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:08.183433    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:09.749408 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:09.749365    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:14:19.515537 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:19.515448    2568 generic.go:356] "Generic (PLEG): container finished" podID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerID="137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056" exitCode=0
Aug 04 00:14:19.515537 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:19.515514    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" event={"ID":"b08dfb23-b942-42a9-a198-c4549013e7f4","Type":"ContainerDied","Data":"137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056"}
Aug 04 00:14:19.516009 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:19.515895    2568 scope.go:117] "RemoveContainer" containerID="137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056"
Aug 04 00:14:19.516948 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:19.516918    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:19.517068 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:19.517000    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:19.517068 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:19.517049    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:20.446166 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:20.446122    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:20.523241 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:20.523199    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" event={"ID":"b08dfb23-b942-42a9-a198-c4549013e7f4","Type":"ContainerStarted","Data":"42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641"}
Aug 04 00:14:21.345362 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:21.345317    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:21.346590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:21.346562    2568 patch_prober.go:28] interesting pod/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 00:14:21.346720 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:21.346627    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 00:14:22.345630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:22.345596    2568 patch_prober.go:28] interesting pod/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 00:14:22.346040 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:22.345651    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 00:14:23.345813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:23.345772    2568 patch_prober.go:28] interesting pod/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 00:14:23.346229 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:23.345841    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 00:14:24.346031 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:24.345990    2568 patch_prober.go:28] interesting pod/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 00:14:24.346492 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:24.346049    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 00:14:25.345700 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:25.345660    2568 patch_prober.go:28] interesting pod/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 00:14:25.345884 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:25.345726    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 00:14:26.348926 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:26.348892    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:26.349387 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:26.349292    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:26.349943 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:26.349923    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:14:31.344663 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:31.344631    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:31.670230 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:31.670143    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:31.941294 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:31.941183    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"]
Aug 04 00:14:31.944917 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:31.944882    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:31.947409 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:31.947384    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b0f5b6-openshift-default-dockercfg-4bgzp\""
Aug 04 00:14:31.956142 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:31.956113    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"]
Aug 04 00:14:31.973561 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:31.973525    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:32.012118 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.012075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-socket\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.012118 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.012121    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-podinfo\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.012344 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.012145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-token\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.012344 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.012223    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-credential-socket\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.012344 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.012271    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-certs\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.012344 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.012309    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsslc\" (UniqueName: \"kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-kube-api-access-fsslc\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.012472 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.012399    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-envoy\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.012472 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.012458    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-data\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.012538 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.012476    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istiod-ca-cert\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.100169 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.100111    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:32.113241 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-data\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113241 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113243    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istiod-ca-cert\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113509 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-socket\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113509 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-podinfo\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113509 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113336    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-token\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113509 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113373    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-credential-socket\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113509 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113389    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-certs\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113509 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113429    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsslc\" (UniqueName: \"kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-kube-api-access-fsslc\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113806 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113707    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-data\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113806 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113720    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-socket\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113806 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113757    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-envoy\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.113806 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113767    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-certs\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.114004 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.113847    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-credential-socket\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.114589 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.114566    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istiod-ca-cert\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.116007 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.115978    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-envoy\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.116153 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.116125    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-podinfo\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.121309 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.121286    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-token\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.121309 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.121310    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsslc\" (UniqueName: \"kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-kube-api-access-fsslc\") pod \"e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") " pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.256132 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.256096    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:32.403805 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.403768    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"]
Aug 04 00:14:32.407063 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:14:32.407035    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc91aee0_3647_4b54_b9a1_edf08e7d2476.slice/crio-fa136e87830e5429de072c4d60febb07cbd6a3400f50e16a978c05472ee0d8e8 WatchSource:0}: Error finding container fa136e87830e5429de072c4d60febb07cbd6a3400f50e16a978c05472ee0d8e8: Status 404 returned error can't find the container with id fa136e87830e5429de072c4d60febb07cbd6a3400f50e16a978c05472ee0d8e8
Aug 04 00:14:32.409246 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.409212    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:32.409346 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.409309    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:32.409346 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.409341    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:32.582845 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.582740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" event={"ID":"cc91aee0-3647-4b54-b9a1-edf08e7d2476","Type":"ContainerStarted","Data":"0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b"}
Aug 04 00:14:32.582845 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.582802    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" event={"ID":"cc91aee0-3647-4b54-b9a1-edf08e7d2476","Type":"ContainerStarted","Data":"fa136e87830e5429de072c4d60febb07cbd6a3400f50e16a978c05472ee0d8e8"}
Aug 04 00:14:32.600799 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:32.600743    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" podStartSLOduration=1.6007258100000001 podStartE2EDuration="1.60072581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:14:32.599797882 +0000 UTC m=+2673.486126360" watchObservedRunningTime="2026-08-04 00:14:32.60072581 +0000 UTC m=+2673.487054253"
Aug 04 00:14:33.256948 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:33.256910    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:33.262318 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:33.262291    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:33.587825 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:33.587728    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:33.588606 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:33.588587    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:34.511077 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:34.511045    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:34.603203 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:34.603169    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:35.824949 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:35.824919    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:36.085300 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:36.085186    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:36.381630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:36.381548    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:36.482792 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:36.482763    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:14:38.651306 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:38.651270    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:14:48.589902 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:48.589861    2568 patch_prober.go:28] interesting pod/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:14:48.590470 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:48.589940    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:14:48.667937 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:48.667904    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerID="0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b" exitCode=0
Aug 04 00:14:48.668133 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:48.667979    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" event={"ID":"cc91aee0-3647-4b54-b9a1-edf08e7d2476","Type":"ContainerDied","Data":"0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b"}
Aug 04 00:14:48.668444 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:48.668427    2568 scope.go:117] "RemoveContainer" containerID="0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b"
Aug 04 00:14:48.669455 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:48.669429    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:48.669513 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:48.669495    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:48.669553 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:48.669526    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:14:49.674250 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:49.674206    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" event={"ID":"cc91aee0-3647-4b54-b9a1-edf08e7d2476","Type":"ContainerStarted","Data":"9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4"}
Aug 04 00:14:50.256849 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:50.256816    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:50.257041 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:50.256995    2568 patch_prober.go:28] interesting pod/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:14:50.257093 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:50.257033    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:14:51.257147 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:51.257098    2568 patch_prober.go:28] interesting pod/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:14:51.257678 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:51.257167    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:14:52.256655 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:52.256609    2568 patch_prober.go:28] interesting pod/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:14:52.256855 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:52.256691    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:14:53.257329 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:53.257291    2568 patch_prober.go:28] interesting pod/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:14:53.257729 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:53.257347    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:14:54.257177 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:54.257138    2568 patch_prober.go:28] interesting pod/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:14:54.257398 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:54.257206    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:14:55.261172 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:55.261140    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:55.261756 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:55.261550    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:55.262315 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:55.262292    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:14:59.448531 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:14:59.448491    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:15:06.834939 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.834899    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"]
Aug 04 00:15:06.837547 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.837524    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:06.840750 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.840724    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e43d99\"/\"openshift-service-ca.crt\""
Aug 04 00:15:06.840750 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.840742    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e43d99\"/\"test-model-e43d99-kserve-self-signed-certs\""
Aug 04 00:15:06.840960 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.840758    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e43d99\"/\"kube-root-ca.crt\""
Aug 04 00:15:06.840960 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.840873    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e43d99\"/\"default-dockercfg-x6qw9\""
Aug 04 00:15:06.845728 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.845703    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"]
Aug 04 00:15:06.861441 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.861387    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:15:06.940749 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.940704    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tls-certs\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:06.940749 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.940751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tmp-dir\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:06.940957 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.940852    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-model-cache\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:06.940957 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.940884    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-dshm\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:06.940957 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.940903    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v4km\" (UniqueName: \"kubernetes.io/projected/816bdd5f-c8fa-4230-9770-e9bcdd35b263-kube-api-access-8v4km\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:06.941060 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:06.940955    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-home\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.042094 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.042053    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tls-certs\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.042339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.042109    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tmp-dir\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.042339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.042176    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-model-cache\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.042339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.042200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-dshm\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.042339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.042226    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v4km\" (UniqueName: \"kubernetes.io/projected/816bdd5f-c8fa-4230-9770-e9bcdd35b263-kube-api-access-8v4km\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.042339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.042253    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-home\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.042810 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.042784    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-home\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.043728 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.042975    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-model-cache\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.043888 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.043240    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tmp-dir\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.046082 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.046054    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-dshm\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.046695 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.046671    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tls-certs\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.051892 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.051860    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v4km\" (UniqueName: \"kubernetes.io/projected/816bdd5f-c8fa-4230-9770-e9bcdd35b263-kube-api-access-8v4km\") pod \"test-model-e43d99-kserve-6cf49c8c7c-qc6z4\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") " pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.148969 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.148871    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:07.286749 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.286643    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"]
Aug 04 00:15:07.289047 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:15:07.289016    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod816bdd5f_c8fa_4230_9770_e9bcdd35b263.slice/crio-a52440ec93a20d1046b3c6749b2eee5c4bc7903412c18e30767265be3d29dd4c WatchSource:0}: Error finding container a52440ec93a20d1046b3c6749b2eee5c4bc7903412c18e30767265be3d29dd4c: Status 404 returned error can't find the container with id a52440ec93a20d1046b3c6749b2eee5c4bc7903412c18e30767265be3d29dd4c
Aug 04 00:15:07.764045 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.764003    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4" event={"ID":"816bdd5f-c8fa-4230-9770-e9bcdd35b263","Type":"ContainerStarted","Data":"cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e"}
Aug 04 00:15:07.764234 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.764054    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4" event={"ID":"816bdd5f-c8fa-4230-9770-e9bcdd35b263","Type":"ContainerStarted","Data":"a52440ec93a20d1046b3c6749b2eee5c4bc7903412c18e30767265be3d29dd4c"}
Aug 04 00:15:07.780112 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:07.780061    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4" podStartSLOduration=1.780046008 podStartE2EDuration="1.780046008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:15:07.778657677 +0000 UTC m=+2708.664986144" watchObservedRunningTime="2026-08-04 00:15:07.780046008 +0000 UTC m=+2708.666374472"
Aug 04 00:15:09.455152 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:09.455116    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:15:15.738843 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:15.738808    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:15:17.149161 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:17.149118    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:17.149608 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:17.149175    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:17.162301 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:17.162248    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:17.826199 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:17.826172    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:15:25.642038 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.642005    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"]
Aug 04 00:15:25.644625 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.644604    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.647393 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.647369    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b0f5b6\"/\"openshift-service-ca.crt\""
Aug 04 00:15:25.647511 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.647376    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b0f5b6\"/\"default-dockercfg-6s76n\""
Aug 04 00:15:25.648429 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.648410    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b0f5b6\"/\"kube-root-ca.crt\""
Aug 04 00:15:25.648527 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.648451    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b0f5b6\"/\"test-model-b0f5b6-kserve-self-signed-certs\""
Aug 04 00:15:25.651646 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.651623    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"]
Aug 04 00:15:25.667575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.667540    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:15:25.714814 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.714774    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8c3424-773d-48d0-b118-1afb98a0b124-tls-certs\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.714814 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.714813    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfrnl\" (UniqueName: \"kubernetes.io/projected/2a8c3424-773d-48d0-b118-1afb98a0b124-kube-api-access-gfrnl\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.715067 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.714842    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-dshm\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.715126 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.715081    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-model-cache\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.715186 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.715123    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-home\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.715241 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.715189    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-tmp-dir\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.816204 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.816168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-model-cache\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.816204 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.816204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-home\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.816505 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.816239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-tmp-dir\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.816505 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.816293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8c3424-773d-48d0-b118-1afb98a0b124-tls-certs\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.816505 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.816320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfrnl\" (UniqueName: \"kubernetes.io/projected/2a8c3424-773d-48d0-b118-1afb98a0b124-kube-api-access-gfrnl\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.816505 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.816344    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-dshm\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.816718 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.816669    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-model-cache\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.816718 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.816680    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-tmp-dir\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.816788 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.816739    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-home\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.818731 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.818712    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-dshm\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.818968 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.818951    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8c3424-773d-48d0-b118-1afb98a0b124-tls-certs\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.823894 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.823871    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfrnl\" (UniqueName: \"kubernetes.io/projected/2a8c3424-773d-48d0-b118-1afb98a0b124-kube-api-access-gfrnl\") pod \"test-model-b0f5b6-kserve-7b7d557759-fx5sq\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") " pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:25.955913 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:25.955806    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:26.089089 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:26.089061    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"]
Aug 04 00:15:26.091347 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:15:26.091316    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a8c3424_773d_48d0_b118_1afb98a0b124.slice/crio-41c4c9c3643726fb031b71b792ad0416ea0d78290d146652d0be02b3419778d5 WatchSource:0}: Error finding container 41c4c9c3643726fb031b71b792ad0416ea0d78290d146652d0be02b3419778d5: Status 404 returned error can't find the container with id 41c4c9c3643726fb031b71b792ad0416ea0d78290d146652d0be02b3419778d5
Aug 04 00:15:26.859101 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:26.859071    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq" event={"ID":"2a8c3424-773d-48d0-b118-1afb98a0b124","Type":"ContainerStarted","Data":"855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd"}
Aug 04 00:15:26.859574 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:26.859109    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq" event={"ID":"2a8c3424-773d-48d0-b118-1afb98a0b124","Type":"ContainerStarted","Data":"41c4c9c3643726fb031b71b792ad0416ea0d78290d146652d0be02b3419778d5"}
Aug 04 00:15:26.875889 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:26.875838    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq" podStartSLOduration=1.875812544 podStartE2EDuration="1.875812544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:15:26.873343136 +0000 UTC m=+2727.759671600" watchObservedRunningTime="2026-08-04 00:15:26.875812544 +0000 UTC m=+2727.762141047"
Aug 04 00:15:29.945489 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:29.945445    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:15:35.956285 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:35.956214    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:35.956698 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:35.956301    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:35.969090 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:35.969065    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:15:36.922001 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:15:36.921968    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:16:08.577851 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:08.577807    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"]
Aug 04 00:16:08.597562 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:08.597519    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:09.456539 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:09.456506    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"]
Aug 04 00:16:10.399913 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:10.399873    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:10.449605 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:10.449568    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:16:16.347312 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:16.347253    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:16:20.042362 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:20.042244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:20.105084 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:20.105046    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:20.189167 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:20.189134    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:20.240382 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:20.240340    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:20.576990 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:20.576951    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:22.249626 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:22.249585    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:16:23.597687 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.597646    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4" podUID="816bdd5f-c8fa-4230-9770-e9bcdd35b263" containerName="main" containerID="cri-o://cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e" gracePeriod=45
Aug 04 00:16:23.850992 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.850927    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:16:23.960254 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960215    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-dshm\") pod \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") "
Aug 04 00:16:23.960254 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960295    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tls-certs\") pod \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") "
Aug 04 00:16:23.960514 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960336    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tmp-dir\") pod \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") "
Aug 04 00:16:23.960514 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960424    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-model-cache\") pod \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") "
Aug 04 00:16:23.960514 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960452    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v4km\" (UniqueName: \"kubernetes.io/projected/816bdd5f-c8fa-4230-9770-e9bcdd35b263-kube-api-access-8v4km\") pod \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") "
Aug 04 00:16:23.960514 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960478    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-home\") pod \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\" (UID: \"816bdd5f-c8fa-4230-9770-e9bcdd35b263\") "
Aug 04 00:16:23.960723 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960650    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "816bdd5f-c8fa-4230-9770-e9bcdd35b263" (UID: "816bdd5f-c8fa-4230-9770-e9bcdd35b263"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:23.960785 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960729    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-model-cache" (OuterVolumeSpecName: "model-cache") pod "816bdd5f-c8fa-4230-9770-e9bcdd35b263" (UID: "816bdd5f-c8fa-4230-9770-e9bcdd35b263"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:23.960878 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960827    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-home" (OuterVolumeSpecName: "home") pod "816bdd5f-c8fa-4230-9770-e9bcdd35b263" (UID: "816bdd5f-c8fa-4230-9770-e9bcdd35b263"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:23.960878 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960869    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-model-cache\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:23.961256 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.960891    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tmp-dir\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:23.962680 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.962655    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-dshm" (OuterVolumeSpecName: "dshm") pod "816bdd5f-c8fa-4230-9770-e9bcdd35b263" (UID: "816bdd5f-c8fa-4230-9770-e9bcdd35b263"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:23.962782 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.962693    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "816bdd5f-c8fa-4230-9770-e9bcdd35b263" (UID: "816bdd5f-c8fa-4230-9770-e9bcdd35b263"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:16:23.962782 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:23.962701    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816bdd5f-c8fa-4230-9770-e9bcdd35b263-kube-api-access-8v4km" (OuterVolumeSpecName: "kube-api-access-8v4km") pod "816bdd5f-c8fa-4230-9770-e9bcdd35b263" (UID: "816bdd5f-c8fa-4230-9770-e9bcdd35b263"). InnerVolumeSpecName "kube-api-access-8v4km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:16:24.061422 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.061386    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v4km\" (UniqueName: \"kubernetes.io/projected/816bdd5f-c8fa-4230-9770-e9bcdd35b263-kube-api-access-8v4km\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:24.061422 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.061415    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-home\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:24.061422 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.061425    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/816bdd5f-c8fa-4230-9770-e9bcdd35b263-dshm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:24.061668 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.061433    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/816bdd5f-c8fa-4230-9770-e9bcdd35b263-tls-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:24.140634 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.140545    2568 generic.go:356] "Generic (PLEG): container finished" podID="816bdd5f-c8fa-4230-9770-e9bcdd35b263" containerID="cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e" exitCode=0
Aug 04 00:16:24.140634 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.140596    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"
Aug 04 00:16:24.140880 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.140633    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4" event={"ID":"816bdd5f-c8fa-4230-9770-e9bcdd35b263","Type":"ContainerDied","Data":"cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e"}
Aug 04 00:16:24.140880 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.140678    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4" event={"ID":"816bdd5f-c8fa-4230-9770-e9bcdd35b263","Type":"ContainerDied","Data":"a52440ec93a20d1046b3c6749b2eee5c4bc7903412c18e30767265be3d29dd4c"}
Aug 04 00:16:24.140880 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.140695    2568 scope.go:117] "RemoveContainer" containerID="cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e"
Aug 04 00:16:24.150804 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.150787    2568 scope.go:117] "RemoveContainer" containerID="cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e"
Aug 04 00:16:24.151070 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:16:24.151050    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e\": container with ID starting with cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e not found: ID does not exist" containerID="cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e"
Aug 04 00:16:24.151137 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.151079    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e"} err="failed to get container status \"cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e\": rpc error: code = NotFound desc = could not find container \"cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e\": container with ID starting with cfd898224eb885c499b102f039a10c345e7df22f3bc240a90b23741159a2e51e not found: ID does not exist"
Aug 04 00:16:24.162753 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.162727    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"]
Aug 04 00:16:24.168812 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.168792    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e43d99/test-model-e43d99-kserve-6cf49c8c7c-qc6z4"]
Aug 04 00:16:24.476195 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.476153    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq" podUID="2a8c3424-773d-48d0-b118-1afb98a0b124" containerName="main" containerID="cri-o://855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd" gracePeriod=45
Aug 04 00:16:24.734791 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.734734    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:16:24.868792 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.868751    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-tmp-dir\") pod \"2a8c3424-773d-48d0-b118-1afb98a0b124\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") "
Aug 04 00:16:24.868792 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.868792    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-home\") pod \"2a8c3424-773d-48d0-b118-1afb98a0b124\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") "
Aug 04 00:16:24.869050 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.868874    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-dshm\") pod \"2a8c3424-773d-48d0-b118-1afb98a0b124\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") "
Aug 04 00:16:24.869050 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.868904    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-model-cache\") pod \"2a8c3424-773d-48d0-b118-1afb98a0b124\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") "
Aug 04 00:16:24.869050 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.868928    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8c3424-773d-48d0-b118-1afb98a0b124-tls-certs\") pod \"2a8c3424-773d-48d0-b118-1afb98a0b124\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") "
Aug 04 00:16:24.869050 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.868979    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfrnl\" (UniqueName: \"kubernetes.io/projected/2a8c3424-773d-48d0-b118-1afb98a0b124-kube-api-access-gfrnl\") pod \"2a8c3424-773d-48d0-b118-1afb98a0b124\" (UID: \"2a8c3424-773d-48d0-b118-1afb98a0b124\") "
Aug 04 00:16:24.869050 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.869028    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a8c3424-773d-48d0-b118-1afb98a0b124" (UID: "2a8c3424-773d-48d0-b118-1afb98a0b124"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:24.869295 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.869095    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-home" (OuterVolumeSpecName: "home") pod "2a8c3424-773d-48d0-b118-1afb98a0b124" (UID: "2a8c3424-773d-48d0-b118-1afb98a0b124"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:24.869295 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.869178    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a8c3424-773d-48d0-b118-1afb98a0b124" (UID: "2a8c3424-773d-48d0-b118-1afb98a0b124"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:24.869413 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.869392    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-model-cache\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:24.869469 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.869414    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-tmp-dir\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:24.869469 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.869422    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-home\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:24.871315 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.871278    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-dshm" (OuterVolumeSpecName: "dshm") pod "2a8c3424-773d-48d0-b118-1afb98a0b124" (UID: "2a8c3424-773d-48d0-b118-1afb98a0b124"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:24.871432 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.871358    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a8c3424-773d-48d0-b118-1afb98a0b124-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a8c3424-773d-48d0-b118-1afb98a0b124" (UID: "2a8c3424-773d-48d0-b118-1afb98a0b124"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:16:24.871432 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.871362    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8c3424-773d-48d0-b118-1afb98a0b124-kube-api-access-gfrnl" (OuterVolumeSpecName: "kube-api-access-gfrnl") pod "2a8c3424-773d-48d0-b118-1afb98a0b124" (UID: "2a8c3424-773d-48d0-b118-1afb98a0b124"). InnerVolumeSpecName "kube-api-access-gfrnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:16:24.970613 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.970575    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfrnl\" (UniqueName: \"kubernetes.io/projected/2a8c3424-773d-48d0-b118-1afb98a0b124-kube-api-access-gfrnl\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:24.970613 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.970607    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8c3424-773d-48d0-b118-1afb98a0b124-dshm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:24.970613 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:24.970617    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8c3424-773d-48d0-b118-1afb98a0b124-tls-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:25.147390 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.147297    2568 generic.go:356] "Generic (PLEG): container finished" podID="2a8c3424-773d-48d0-b118-1afb98a0b124" containerID="855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd" exitCode=0
Aug 04 00:16:25.147390 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.147347    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"
Aug 04 00:16:25.147609 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.147387    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq" event={"ID":"2a8c3424-773d-48d0-b118-1afb98a0b124","Type":"ContainerDied","Data":"855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd"}
Aug 04 00:16:25.147609 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.147429    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq" event={"ID":"2a8c3424-773d-48d0-b118-1afb98a0b124","Type":"ContainerDied","Data":"41c4c9c3643726fb031b71b792ad0416ea0d78290d146652d0be02b3419778d5"}
Aug 04 00:16:25.147609 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.147449    2568 scope.go:117] "RemoveContainer" containerID="855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd"
Aug 04 00:16:25.156742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.156725    2568 scope.go:117] "RemoveContainer" containerID="855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd"
Aug 04 00:16:25.157003 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:16:25.156987    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd\": container with ID starting with 855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd not found: ID does not exist" containerID="855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd"
Aug 04 00:16:25.157053 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.157011    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd"} err="failed to get container status \"855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd\": rpc error: code = NotFound desc = could not find container \"855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd\": container with ID starting with 855825df5c7dc84a61c11fe3be44d42ade4a8094d0a1da0392160acf3194b5dd not found: ID does not exist"
Aug 04 00:16:25.168847 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.168822    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"]
Aug 04 00:16:25.172132 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.172107    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b0f5b6/test-model-b0f5b6-kserve-7b7d557759-fx5sq"]
Aug 04 00:16:25.660432 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.660394    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a8c3424-773d-48d0-b118-1afb98a0b124" path="/var/lib/kubelet/pods/2a8c3424-773d-48d0-b118-1afb98a0b124/volumes"
Aug 04 00:16:25.660843 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:25.660829    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="816bdd5f-c8fa-4230-9770-e9bcdd35b263" path="/var/lib/kubelet/pods/816bdd5f-c8fa-4230-9770-e9bcdd35b263/volumes"
Aug 04 00:16:26.618481 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:26.618443    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:26.680666 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:26.680632    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:26.859143 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:26.859104    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"]
Aug 04 00:16:26.859457 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:26.859428    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy" containerID="cri-o://42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641" gracePeriod=30
Aug 04 00:16:26.881509 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:26.881424    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:27.101225 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:27.101187    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:32.119645 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.119618    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:16:32.137670 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.137585    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-envoy\") pod \"b08dfb23-b942-42a9-a198-c4549013e7f4\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") "
Aug 04 00:16:32.137670 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.137633    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lqz6\" (UniqueName: \"kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-kube-api-access-7lqz6\") pod \"b08dfb23-b942-42a9-a198-c4549013e7f4\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") "
Aug 04 00:16:32.137670 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.137659    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-certs\") pod \"b08dfb23-b942-42a9-a198-c4549013e7f4\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") "
Aug 04 00:16:32.137912 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.137696    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-data\") pod \"b08dfb23-b942-42a9-a198-c4549013e7f4\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") "
Aug 04 00:16:32.137912 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.137720    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-socket\") pod \"b08dfb23-b942-42a9-a198-c4549013e7f4\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") "
Aug 04 00:16:32.137912 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.137738    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-token\") pod \"b08dfb23-b942-42a9-a198-c4549013e7f4\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") "
Aug 04 00:16:32.137912 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.137778    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b08dfb23-b942-42a9-a198-c4549013e7f4-istiod-ca-cert\") pod \"b08dfb23-b942-42a9-a198-c4549013e7f4\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") "
Aug 04 00:16:32.137912 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.137823    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-credential-socket\") pod \"b08dfb23-b942-42a9-a198-c4549013e7f4\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") "
Aug 04 00:16:32.137912 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.137873    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-podinfo\") pod \"b08dfb23-b942-42a9-a198-c4549013e7f4\" (UID: \"b08dfb23-b942-42a9-a198-c4549013e7f4\") "
Aug 04 00:16:32.138575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.138028    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "b08dfb23-b942-42a9-a198-c4549013e7f4" (UID: "b08dfb23-b942-42a9-a198-c4549013e7f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:32.138575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.138167    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:32.138575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.138181    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b08dfb23-b942-42a9-a198-c4549013e7f4" (UID: "b08dfb23-b942-42a9-a198-c4549013e7f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:32.138575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.138353    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b08dfb23-b942-42a9-a198-c4549013e7f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b08dfb23-b942-42a9-a198-c4549013e7f4" (UID: "b08dfb23-b942-42a9-a198-c4549013e7f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:16:32.139320 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.139277    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b08dfb23-b942-42a9-a198-c4549013e7f4" (UID: "b08dfb23-b942-42a9-a198-c4549013e7f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:32.140091 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.139561    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b08dfb23-b942-42a9-a198-c4549013e7f4" (UID: "b08dfb23-b942-42a9-a198-c4549013e7f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:32.141254 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.141190    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "b08dfb23-b942-42a9-a198-c4549013e7f4" (UID: "b08dfb23-b942-42a9-a198-c4549013e7f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:16:32.141847 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.141823    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-kube-api-access-7lqz6" (OuterVolumeSpecName: "kube-api-access-7lqz6") pod "b08dfb23-b942-42a9-a198-c4549013e7f4" (UID: "b08dfb23-b942-42a9-a198-c4549013e7f4"). InnerVolumeSpecName "kube-api-access-7lqz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:16:32.141981 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.141960    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b08dfb23-b942-42a9-a198-c4549013e7f4" (UID: "b08dfb23-b942-42a9-a198-c4549013e7f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:32.142091 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.142068    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b08dfb23-b942-42a9-a198-c4549013e7f4" (UID: "b08dfb23-b942-42a9-a198-c4549013e7f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:16:32.190778 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.190737    2568 generic.go:356] "Generic (PLEG): container finished" podID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerID="42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641" exitCode=0
Aug 04 00:16:32.190945 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.190785    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"
Aug 04 00:16:32.190945 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.190829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" event={"ID":"b08dfb23-b942-42a9-a198-c4549013e7f4","Type":"ContainerDied","Data":"42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641"}
Aug 04 00:16:32.190945 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.190889    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk" event={"ID":"b08dfb23-b942-42a9-a198-c4549013e7f4","Type":"ContainerDied","Data":"ab37c692416f78d0b3523429aa43b6076bd8c642d90fd82d0d3ed31933be3991"}
Aug 04 00:16:32.190945 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.190912    2568 scope.go:117] "RemoveContainer" containerID="42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641"
Aug 04 00:16:32.201009 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.200991    2568 scope.go:117] "RemoveContainer" containerID="137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056"
Aug 04 00:16:32.209048 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.209028    2568 scope.go:117] "RemoveContainer" containerID="42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641"
Aug 04 00:16:32.209330 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:16:32.209309    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641\": container with ID starting with 42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641 not found: ID does not exist" containerID="42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641"
Aug 04 00:16:32.209413 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.209343    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641"} err="failed to get container status \"42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641\": rpc error: code = NotFound desc = could not find container \"42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641\": container with ID starting with 42789fc4c913764f7c58ff5628e5ad03e41b609d71f0c27c102f0fcc87661641 not found: ID does not exist"
Aug 04 00:16:32.209413 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.209368    2568 scope.go:117] "RemoveContainer" containerID="137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056"
Aug 04 00:16:32.209650 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:16:32.209633    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056\": container with ID starting with 137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056 not found: ID does not exist" containerID="137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056"
Aug 04 00:16:32.209692 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.209656    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056"} err="failed to get container status \"137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056\": rpc error: code = NotFound desc = could not find container \"137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056\": container with ID starting with 137599fb2f6c37b6b037afae95ea541b71054f24ff41d99785502f1c4b2b4056 not found: ID does not exist"
Aug 04 00:16:32.212650 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.212629    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"]
Aug 04 00:16:32.216288 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.216268    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e43d99-openshift-default-77d88cb66b-mdjgk"]
Aug 04 00:16:32.244111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.240501    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:32.244111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.240538    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:32.244111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.240562    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lqz6\" (UniqueName: \"kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-kube-api-access-7lqz6\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:32.244111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.240577    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:32.244111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.240599    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:32.244111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.240611    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b08dfb23-b942-42a9-a198-c4549013e7f4-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:32.244111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.240626    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b08dfb23-b942-42a9-a198-c4549013e7f4-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:32.244111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:32.240638    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b08dfb23-b942-42a9-a198-c4549013e7f4-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:33.659760 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:33.659727    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" path="/var/lib/kubelet/pods/b08dfb23-b942-42a9-a198-c4549013e7f4/volumes"
Aug 04 00:16:37.925281 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:37.925232    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:37.986450 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:37.986423    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:38.085490 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:38.085454    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:38.156358 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:38.156312    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:38.468208 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:38.468168    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:40.342222 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:40.342182    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:16:44.423348 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:44.423291    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:44.483769 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:44.483708    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:44.674114 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:44.674021    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"]
Aug 04 00:16:44.674283 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:44.674245    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy" containerID="cri-o://9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4" gracePeriod=30
Aug 04 00:16:44.688740 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:44.688678    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:44.891794 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:44.891703    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:45.241976 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.241907    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:45.505733 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.505654    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"]
Aug 04 00:16:45.506228 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.505983    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy"
Aug 04 00:16:45.506228 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.505994    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy"
Aug 04 00:16:45.506228 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.506002    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816bdd5f-c8fa-4230-9770-e9bcdd35b263" containerName="main"
Aug 04 00:16:45.506228 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.506009    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="816bdd5f-c8fa-4230-9770-e9bcdd35b263" containerName="main"
Aug 04 00:16:45.506228 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.506018    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a8c3424-773d-48d0-b118-1afb98a0b124" containerName="main"
Aug 04 00:16:45.506228 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.506024    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a8c3424-773d-48d0-b118-1afb98a0b124" containerName="main"
Aug 04 00:16:45.506228 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.506062    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy"
Aug 04 00:16:45.506228 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.506071    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy"
Aug 04 00:16:45.506228 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.506166    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy"
Aug 04 00:16:45.506822 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.506661    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a8c3424-773d-48d0-b118-1afb98a0b124" containerName="main"
Aug 04 00:16:45.506822 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.506687    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="816bdd5f-c8fa-4230-9770-e9bcdd35b263" containerName="main"
Aug 04 00:16:45.509801 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.509782    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.512379 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.512358    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b3817c-openshift-default-dockercfg-xjg8f\""
Aug 04 00:16:45.521237 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.521212    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"]
Aug 04 00:16:45.531958 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.531935    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:45.556333 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.556291    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-podinfo\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.556485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.556344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-credential-socket\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.556485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.556379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-certs\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.556485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.556406    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70758f71-10ea-487d-acb3-4a2b352e70c3-istiod-ca-cert\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.556485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.556427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-socket\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.556485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.556445    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-envoy\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.556485 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.556475    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-token\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.556694 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.556524    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpwn7\" (UniqueName: \"kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-kube-api-access-fpwn7\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.556694 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.556630    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-data\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657054 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657020    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-socket\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657054 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657062    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-envoy\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657088    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-token\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpwn7\" (UniqueName: \"kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-kube-api-access-fpwn7\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657175    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-data\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657236    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-podinfo\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657297    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-credential-socket\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657334    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-certs\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657360    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70758f71-10ea-487d-acb3-4a2b352e70c3-istiod-ca-cert\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-socket\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.657590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657568    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-data\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.658021 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657609    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-credential-socket\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.658021 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.657720    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-certs\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.658779 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.658760    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70758f71-10ea-487d-acb3-4a2b352e70c3-istiod-ca-cert\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.659523 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.659506    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-envoy\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.660221 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.660200    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-podinfo\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.665375 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.665346    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpwn7\" (UniqueName: \"kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-kube-api-access-fpwn7\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.665479 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.665353    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-token\") pod \"e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") " pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.820691 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.820598    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:45.940182 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.940149    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:45.973837 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.967720    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"]
Aug 04 00:16:45.974824 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.974777    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:16:45.974954 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.974867    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:16:45.974954 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:45.974905    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:16:46.259638 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:46.259600    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" event={"ID":"70758f71-10ea-487d-acb3-4a2b352e70c3","Type":"ContainerStarted","Data":"39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e"}
Aug 04 00:16:46.259806 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:46.259653    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" event={"ID":"70758f71-10ea-487d-acb3-4a2b352e70c3","Type":"ContainerStarted","Data":"6baeaf6a1a12334848005df73f3befc3c564a3981076d0738002e43b79f3b982"}
Aug 04 00:16:46.285813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:46.285747    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" podStartSLOduration=1.2857261420000001 podStartE2EDuration="1.285726142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:16:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:16:46.282777596 +0000 UTC m=+2807.169106064" watchObservedRunningTime="2026-08-04 00:16:46.285726142 +0000 UTC m=+2807.172054608"
Aug 04 00:16:46.821562 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:46.821527    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:47.826439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:47.826407    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:48.144299 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:48.144174    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:48.244031 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:48.243992    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:48.269732 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:48.269705    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:48.270758 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:48.270738    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:16:49.297902 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:49.297873    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:49.396992 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:49.396943    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:49.847167 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:49.847116    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:49.947097 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:49.947065    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:16:49.954197 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:49.954176    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:16:50.099617 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.099577    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-data\") pod \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") "
Aug 04 00:16:50.099824 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.099689    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-envoy\") pod \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") "
Aug 04 00:16:50.099824 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.099726    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-credential-socket\") pod \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") "
Aug 04 00:16:50.099824 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.099768    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-podinfo\") pod \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") "
Aug 04 00:16:50.100002 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.099824    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-socket\") pod \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") "
Aug 04 00:16:50.100002 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.099858    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsslc\" (UniqueName: \"kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-kube-api-access-fsslc\") pod \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") "
Aug 04 00:16:50.100002 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.099885    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-token\") pod \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") "
Aug 04 00:16:50.100002 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.099914    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-certs\") pod \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") "
Aug 04 00:16:50.100002 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.099938    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istiod-ca-cert\") pod \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\" (UID: \"cc91aee0-3647-4b54-b9a1-edf08e7d2476\") "
Aug 04 00:16:50.100002 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.099913    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc91aee0-3647-4b54-b9a1-edf08e7d2476" (UID: "cc91aee0-3647-4b54-b9a1-edf08e7d2476"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:50.100343 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.100067    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc91aee0-3647-4b54-b9a1-edf08e7d2476" (UID: "cc91aee0-3647-4b54-b9a1-edf08e7d2476"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:50.100343 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.100288    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:50.100343 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.100311    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:50.100493 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.100393    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc91aee0-3647-4b54-b9a1-edf08e7d2476" (UID: "cc91aee0-3647-4b54-b9a1-edf08e7d2476"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:16:50.100553 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.100492    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc91aee0-3647-4b54-b9a1-edf08e7d2476" (UID: "cc91aee0-3647-4b54-b9a1-edf08e7d2476"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:50.100855 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.100819    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc91aee0-3647-4b54-b9a1-edf08e7d2476" (UID: "cc91aee0-3647-4b54-b9a1-edf08e7d2476"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:50.102352 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.102237    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc91aee0-3647-4b54-b9a1-edf08e7d2476" (UID: "cc91aee0-3647-4b54-b9a1-edf08e7d2476"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:16:50.102741 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.102713    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc91aee0-3647-4b54-b9a1-edf08e7d2476" (UID: "cc91aee0-3647-4b54-b9a1-edf08e7d2476"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:16:50.102804 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.102741    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-kube-api-access-fsslc" (OuterVolumeSpecName: "kube-api-access-fsslc") pod "cc91aee0-3647-4b54-b9a1-edf08e7d2476" (UID: "cc91aee0-3647-4b54-b9a1-edf08e7d2476"). InnerVolumeSpecName "kube-api-access-fsslc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:16:50.103376 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.103347    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc91aee0-3647-4b54-b9a1-edf08e7d2476" (UID: "cc91aee0-3647-4b54-b9a1-edf08e7d2476"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:16:50.201581 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.201494    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:50.201581 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.201523    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:50.201581 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.201534    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsslc\" (UniqueName: \"kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-kube-api-access-fsslc\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:50.201581 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.201547    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:50.201581 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.201559    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:50.201581 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.201570    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:50.201581 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.201581    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc91aee0-3647-4b54-b9a1-edf08e7d2476-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:16:50.280660 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.280620    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerID="9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4" exitCode=0
Aug 04 00:16:50.280827 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.280686    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"
Aug 04 00:16:50.280827 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.280711    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" event={"ID":"cc91aee0-3647-4b54-b9a1-edf08e7d2476","Type":"ContainerDied","Data":"9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4"}
Aug 04 00:16:50.280827 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.280791    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv" event={"ID":"cc91aee0-3647-4b54-b9a1-edf08e7d2476","Type":"ContainerDied","Data":"fa136e87830e5429de072c4d60febb07cbd6a3400f50e16a978c05472ee0d8e8"}
Aug 04 00:16:50.280827 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.280815    2568 scope.go:117] "RemoveContainer" containerID="9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4"
Aug 04 00:16:50.290059 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.290041    2568 scope.go:117] "RemoveContainer" containerID="0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b"
Aug 04 00:16:50.299050 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.299031    2568 scope.go:117] "RemoveContainer" containerID="9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4"
Aug 04 00:16:50.299388 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:16:50.299317    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4\": container with ID starting with 9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4 not found: ID does not exist" containerID="9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4"
Aug 04 00:16:50.299388 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.299345    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4"} err="failed to get container status \"9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4\": rpc error: code = NotFound desc = could not find container \"9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4\": container with ID starting with 9ea9f05d423b40371b6b70515c2c2f8da80161d66b17b4746e6cff7395952bb4 not found: ID does not exist"
Aug 04 00:16:50.299388 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.299364    2568 scope.go:117] "RemoveContainer" containerID="0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b"
Aug 04 00:16:50.299637 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:16:50.299620    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b\": container with ID starting with 0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b not found: ID does not exist" containerID="0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b"
Aug 04 00:16:50.299688 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.299643    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b"} err="failed to get container status \"0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b\": rpc error: code = NotFound desc = could not find container \"0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b\": container with ID starting with 0fe45a885b70b0c419b2cfde8c94b291d61c5d5b80e6ce0fbba7885ed097af9b not found: ID does not exist"
Aug 04 00:16:50.304343 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.304324    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"]
Aug 04 00:16:50.307498 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:50.307477    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b0f5b6-openshift-default-584dd7c6cd-gh7cv"]
Aug 04 00:16:51.660172 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:51.660126    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" path="/var/lib/kubelet/pods/cc91aee0-3647-4b54-b9a1-edf08e7d2476/volumes"
Aug 04 00:16:51.850799 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:16:51.850761    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:17:02.351299 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:02.351239    2568 generic.go:356] "Generic (PLEG): container finished" podID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerID="39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e" exitCode=0
Aug 04 00:17:02.351796 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:02.351314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" event={"ID":"70758f71-10ea-487d-acb3-4a2b352e70c3","Type":"ContainerDied","Data":"39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e"}
Aug 04 00:17:02.351796 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:02.351695    2568 scope.go:117] "RemoveContainer" containerID="39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e"
Aug 04 00:17:02.352812 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:02.352783    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:17:02.352881 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:02.352855    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:17:02.352918 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:02.352886    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:17:03.270223 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:03.270184    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:17:03.364136 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:03.364094    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" event={"ID":"70758f71-10ea-487d-acb3-4a2b352e70c3","Type":"ContainerStarted","Data":"18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a"}
Aug 04 00:17:03.821369 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:03.821328    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:17:03.822621 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:03.822595    2568 patch_prober.go:28] interesting pod/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 00:17:03.822727 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:03.822656    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 00:17:04.821885 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:04.821839    2568 patch_prober.go:28] interesting pod/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 00:17:04.822360 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:04.821913    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 00:17:05.821977 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:05.821936    2568 patch_prober.go:28] interesting pod/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 00:17:05.822409 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:05.821999    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 00:17:06.822069 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:06.822030    2568 patch_prober.go:28] interesting pod/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 00:17:06.822501 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:06.822116    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 00:17:07.821325 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:07.821282    2568 patch_prober.go:28] interesting pod/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 00:17:07.821497 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:07.821359    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 00:17:08.825504 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:08.825470    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:17:08.825957 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:08.825887    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:17:08.826560 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:08.826534    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:17:13.131710 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.131671    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:13.595438 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.595400    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:13.862484 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.862397    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"]
Aug 04 00:17:13.862742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.862730    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy"
Aug 04 00:17:13.862795 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.862743    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy"
Aug 04 00:17:13.862833 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.862800    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy"
Aug 04 00:17:13.862833 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.862809    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b08dfb23-b942-42a9-a198-c4549013e7f4" containerName="istio-proxy"
Aug 04 00:17:13.862833 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.862816    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy"
Aug 04 00:17:13.864869 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.864847    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:13.867117 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.867093    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-35e594-openshift-default-dockercfg-tbdql\""
Aug 04 00:17:13.878294 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.878251    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"]
Aug 04 00:17:13.891243 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.891210    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:13.910605 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.910566    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-certs\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:13.910797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.910627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxft7\" (UniqueName: \"kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-kube-api-access-cxft7\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:13.910797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.910687    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-token\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:13.910797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.910734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-socket\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:13.910797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.910770    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-data\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:13.910797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.910787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istiod-ca-cert\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:13.911121 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.910805    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-envoy\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:13.911121 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.910937    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-credential-socket\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:13.911121 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:13.910990    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-podinfo\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.011597 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.011560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-token\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.011597 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.011597    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-socket\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.011881 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.011618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-data\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.011881 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.011641    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istiod-ca-cert\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.011881 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.011672    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-envoy\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.011881 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.011793    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-credential-socket\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.011881 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.011862    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-podinfo\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.012147 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.011906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-certs\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.012147 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.011939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxft7\" (UniqueName: \"kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-kube-api-access-cxft7\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.012147 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.012040    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-data\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.012147 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.012080    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-socket\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.012147 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.012139    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-credential-socket\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.012402 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.012312    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-certs\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.012523 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.012504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istiod-ca-cert\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.014127 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.014104    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-envoy\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.014469 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.014452    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-podinfo\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.023244 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.023209    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-token\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.023518 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.023501    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxft7\" (UniqueName: \"kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-kube-api-access-cxft7\") pod \"e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") " pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.176841 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.176744    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:14.240596 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.240217    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:14.322171 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.322146    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"]
Aug 04 00:17:14.324311 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:17:14.324281    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13b7bd4_04b1_4840_8580_6f41c0ece80c.slice/crio-cda2ccc3e59e693d431265783dfa869a00af4ea962c05eb0dd56959fa246eb8b WatchSource:0}: Error finding container cda2ccc3e59e693d431265783dfa869a00af4ea962c05eb0dd56959fa246eb8b: Status 404 returned error can't find the container with id cda2ccc3e59e693d431265783dfa869a00af4ea962c05eb0dd56959fa246eb8b
Aug 04 00:17:14.326537 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.326508    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:17:14.326602 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.326567    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:17:14.326638 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.326606    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:17:14.418043 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.418005    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" event={"ID":"f13b7bd4-04b1-4840-8580-6f41c0ece80c","Type":"ContainerStarted","Data":"e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52"}
Aug 04 00:17:14.418208 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.418070    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" event={"ID":"f13b7bd4-04b1-4840-8580-6f41c0ece80c","Type":"ContainerStarted","Data":"cda2ccc3e59e693d431265783dfa869a00af4ea962c05eb0dd56959fa246eb8b"}
Aug 04 00:17:14.442289 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:14.442162    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" podStartSLOduration=1.442141934 podStartE2EDuration="1.442141934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:17:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:17:14.439541362 +0000 UTC m=+2835.325869827" watchObservedRunningTime="2026-08-04 00:17:14.442141934 +0000 UTC m=+2835.328470401"
Aug 04 00:17:15.177545 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:15.177504    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:15.182705 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:15.182675    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:15.423111 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:15.423078    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:15.424046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:15.424025    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:16.301506 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:16.301467    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:16.405588 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:16.405554    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:17.630710 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:17.630676    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:17.971831 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:17.971797    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:18.191255 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:18.191214    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:18.287895 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:18.287808    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:21.053861 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:21.053822    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:17:30.526219 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:30.526164    2568 patch_prober.go:28] interesting pod/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": read tcp 10.134.0.2:58688->10.134.0.53:15021: read: connection reset by peer" start-of-body=
Aug 04 00:17:30.526665 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:30.526253    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": read tcp 10.134.0.2:58688->10.134.0.53:15021: read: connection reset by peer"
Aug 04 00:17:30.749503 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:30.749471    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:17:31.508347 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:31.508312    2568 generic.go:356] "Generic (PLEG): container finished" podID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerID="e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52" exitCode=0
Aug 04 00:17:31.508523 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:31.508386    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" event={"ID":"f13b7bd4-04b1-4840-8580-6f41c0ece80c","Type":"ContainerDied","Data":"e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52"}
Aug 04 00:17:31.508777 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:31.508762    2568 scope.go:117] "RemoveContainer" containerID="e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52"
Aug 04 00:17:31.509774 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:31.509746    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:17:31.509835 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:31.509812    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:17:31.509871 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:31.509844    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:17:32.518692 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:32.518656    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" event={"ID":"f13b7bd4-04b1-4840-8580-6f41c0ece80c","Type":"ContainerStarted","Data":"8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661"}
Aug 04 00:17:33.177901 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:33.177862    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:33.178100 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:33.178076    2568 patch_prober.go:28] interesting pod/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Aug 04 00:17:33.178150 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:33.178126    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Aug 04 00:17:34.178161 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:34.178115    2568 patch_prober.go:28] interesting pod/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Aug 04 00:17:34.178689 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:34.178179    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Aug 04 00:17:35.177156 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:35.177115    2568 patch_prober.go:28] interesting pod/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Aug 04 00:17:35.177388 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:35.177175    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Aug 04 00:17:36.177907 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:36.177866    2568 patch_prober.go:28] interesting pod/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Aug 04 00:17:36.178350 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:36.177924    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Aug 04 00:17:37.177894 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:37.177853    2568 patch_prober.go:28] interesting pod/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Aug 04 00:17:37.178084 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:37.177914    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Aug 04 00:17:38.181057 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:38.181023    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:38.181481 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:38.181306    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:38.181916 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:38.181902    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:17:46.377219 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:17:46.377181    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:04.919339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:04.919208    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:04.989756 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:04.989725    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:05.046018 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:05.045988    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:05.105158 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:05.105123    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:05.446110 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:05.446073    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:07.246106 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:07.246071    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:18:11.496740 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:11.496702    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:11.597064 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:11.597031    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:11.736387 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:11.736354    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"]
Aug 04 00:18:11.736583 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:11.736560    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy" containerID="cri-o://18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a" gracePeriod=30
Aug 04 00:18:11.758928 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:11.758850    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:12.039900 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:12.039804    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:16.980025 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:16.979998    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:18:17.080528 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080444    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-certs\") pod \"70758f71-10ea-487d-acb3-4a2b352e70c3\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") "
Aug 04 00:18:17.080528 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080485    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-envoy\") pod \"70758f71-10ea-487d-acb3-4a2b352e70c3\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") "
Aug 04 00:18:17.080528 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080520    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-data\") pod \"70758f71-10ea-487d-acb3-4a2b352e70c3\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") "
Aug 04 00:18:17.080793 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080553    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70758f71-10ea-487d-acb3-4a2b352e70c3-istiod-ca-cert\") pod \"70758f71-10ea-487d-acb3-4a2b352e70c3\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") "
Aug 04 00:18:17.080793 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080580    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-credential-socket\") pod \"70758f71-10ea-487d-acb3-4a2b352e70c3\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") "
Aug 04 00:18:17.080793 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080608    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-socket\") pod \"70758f71-10ea-487d-acb3-4a2b352e70c3\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") "
Aug 04 00:18:17.080793 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080650    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-token\") pod \"70758f71-10ea-487d-acb3-4a2b352e70c3\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") "
Aug 04 00:18:17.080793 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080676    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-podinfo\") pod \"70758f71-10ea-487d-acb3-4a2b352e70c3\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") "
Aug 04 00:18:17.080793 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080709    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpwn7\" (UniqueName: \"kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-kube-api-access-fpwn7\") pod \"70758f71-10ea-487d-acb3-4a2b352e70c3\" (UID: \"70758f71-10ea-487d-acb3-4a2b352e70c3\") "
Aug 04 00:18:17.081110 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080799    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70758f71-10ea-487d-acb3-4a2b352e70c3" (UID: "70758f71-10ea-487d-acb3-4a2b352e70c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:18:17.081110 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.080832    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "70758f71-10ea-487d-acb3-4a2b352e70c3" (UID: "70758f71-10ea-487d-acb3-4a2b352e70c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:18:17.081110 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.081013    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:17.081110 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.081030    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:17.081110 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.081031    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70758f71-10ea-487d-acb3-4a2b352e70c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70758f71-10ea-487d-acb3-4a2b352e70c3" (UID: "70758f71-10ea-487d-acb3-4a2b352e70c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:18:17.081398 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.081311    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70758f71-10ea-487d-acb3-4a2b352e70c3" (UID: "70758f71-10ea-487d-acb3-4a2b352e70c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:18:17.081547 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.081431    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70758f71-10ea-487d-acb3-4a2b352e70c3" (UID: "70758f71-10ea-487d-acb3-4a2b352e70c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:18:17.082933 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.082907    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70758f71-10ea-487d-acb3-4a2b352e70c3" (UID: "70758f71-10ea-487d-acb3-4a2b352e70c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:18:17.083437 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.083411    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70758f71-10ea-487d-acb3-4a2b352e70c3" (UID: "70758f71-10ea-487d-acb3-4a2b352e70c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:18:17.083544 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.083513    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-kube-api-access-fpwn7" (OuterVolumeSpecName: "kube-api-access-fpwn7") pod "70758f71-10ea-487d-acb3-4a2b352e70c3" (UID: "70758f71-10ea-487d-acb3-4a2b352e70c3"). InnerVolumeSpecName "kube-api-access-fpwn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:18:17.083661 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.083552    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "70758f71-10ea-487d-acb3-4a2b352e70c3" (UID: "70758f71-10ea-487d-acb3-4a2b352e70c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:18:17.181499 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.181456    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:17.181499 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.181488    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:17.181499 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.181498    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpwn7\" (UniqueName: \"kubernetes.io/projected/70758f71-10ea-487d-acb3-4a2b352e70c3-kube-api-access-fpwn7\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:17.181499 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.181509    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:17.181766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.181517    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70758f71-10ea-487d-acb3-4a2b352e70c3-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:17.181766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.181526    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:17.181766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.181537    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70758f71-10ea-487d-acb3-4a2b352e70c3-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:17.738783 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.738743    2568 generic.go:356] "Generic (PLEG): container finished" podID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerID="18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a" exitCode=0
Aug 04 00:18:17.738944 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.738795    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"
Aug 04 00:18:17.738944 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.738830    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" event={"ID":"70758f71-10ea-487d-acb3-4a2b352e70c3","Type":"ContainerDied","Data":"18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a"}
Aug 04 00:18:17.738944 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.738882    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65" event={"ID":"70758f71-10ea-487d-acb3-4a2b352e70c3","Type":"ContainerDied","Data":"6baeaf6a1a12334848005df73f3befc3c564a3981076d0738002e43b79f3b982"}
Aug 04 00:18:17.738944 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.738910    2568 scope.go:117] "RemoveContainer" containerID="18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a"
Aug 04 00:18:17.747738 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.747722    2568 scope.go:117] "RemoveContainer" containerID="39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e"
Aug 04 00:18:17.755857 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.755831    2568 scope.go:117] "RemoveContainer" containerID="18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a"
Aug 04 00:18:17.756137 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:18:17.756116    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a\": container with ID starting with 18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a not found: ID does not exist" containerID="18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a"
Aug 04 00:18:17.756182 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.756146    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a"} err="failed to get container status \"18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a\": rpc error: code = NotFound desc = could not find container \"18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a\": container with ID starting with 18f2204a6bdec98682d637eef9a1980f6dde8b715852545bacdea5575aca1f7a not found: ID does not exist"
Aug 04 00:18:17.756182 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.756165    2568 scope.go:117] "RemoveContainer" containerID="39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e"
Aug 04 00:18:17.756415 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:18:17.756395    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e\": container with ID starting with 39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e not found: ID does not exist" containerID="39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e"
Aug 04 00:18:17.756488 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.756422    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e"} err="failed to get container status \"39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e\": rpc error: code = NotFound desc = could not find container \"39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e\": container with ID starting with 39c40263cd2be4b48cc5707972424f2697b05cc76c29671efdc9f04a1fb4f24e not found: ID does not exist"
Aug 04 00:18:17.761957 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.761935    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"]
Aug 04 00:18:17.767090 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:17.767069    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b3817c-openshift-default-5cfd7d8bd4-nzn65"]
Aug 04 00:18:19.659636 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:19.659602    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" path="/var/lib/kubelet/pods/70758f71-10ea-487d-acb3-4a2b352e70c3/volumes"
Aug 04 00:18:27.654504 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:27.654463    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:27.746327 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:27.746288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:27.805842 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:27.805805    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:27.860555 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:27.860528    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:28.240811 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:28.240773    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:29.753819 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:29.753785    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:18:34.319200 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:34.319161    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:34.419370 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:34.419336    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:34.556851 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:34.556810    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"]
Aug 04 00:18:34.557142 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:34.557113    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy" containerID="cri-o://8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661" gracePeriod=30
Aug 04 00:18:34.573128 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:34.573013    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:34.792227 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:34.792187    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:35.131206 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.131176    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:35.411024 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.410928    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"]
Aug 04 00:18:35.411488 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.411431    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy"
Aug 04 00:18:35.411488 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.411451    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy"
Aug 04 00:18:35.411603 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.411488    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy"
Aug 04 00:18:35.411603 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.411498    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc91aee0-3647-4b54-b9a1-edf08e7d2476" containerName="istio-proxy"
Aug 04 00:18:35.411603 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.411576    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy"
Aug 04 00:18:35.411603 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.411590    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy"
Aug 04 00:18:35.414634 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.414612    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.416916 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.416889    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-1769a3-openshift-default-dockercfg-9sjp5\""
Aug 04 00:18:35.426601 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.426572    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"]
Aug 04 00:18:35.447244 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.447212    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:35.544801 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.544760    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-data\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.544801 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.544803    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-socket\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.545046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.544825    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsdwq\" (UniqueName: \"kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-kube-api-access-gsdwq\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.545046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.544904    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-credential-socket\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.545046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.544976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-istio-token\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.545046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.545019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-certs\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.545046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.545037    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485d9705-f129-465b-8b42-db7bafc309e6-istiod-ca-cert\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.545329 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.545148    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-envoy\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.545329 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.545184    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485d9705-f129-465b-8b42-db7bafc309e6-istio-podinfo\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.644454 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.644425    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:35.646591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.646573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-envoy\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.646650 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.646599    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485d9705-f129-465b-8b42-db7bafc309e6-istio-podinfo\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.646650 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.646623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-data\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.646650 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.646642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-socket\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.646803 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.646695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsdwq\" (UniqueName: \"kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-kube-api-access-gsdwq\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.646803 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.646745    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-credential-socket\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.646803 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.646773    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-istio-token\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.646958 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.646821    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-certs\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.646958 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.646850    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485d9705-f129-465b-8b42-db7bafc309e6-istiod-ca-cert\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.647114 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.647091    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-data\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.647178 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.647116    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-socket\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.647371 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.647330    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-credential-socket\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.647627 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.647604    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-certs\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.647694 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.647617    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485d9705-f129-465b-8b42-db7bafc309e6-istiod-ca-cert\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.649169 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.649149    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-envoy\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.649325 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.649311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485d9705-f129-465b-8b42-db7bafc309e6-istio-podinfo\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.655712 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.655683    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-istio-token\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.655810 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.655794    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsdwq\" (UniqueName: \"kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-kube-api-access-gsdwq\") pod \"e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") " pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.724846 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.724817    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:35.861748 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.861714    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"]
Aug 04 00:18:35.865377 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:18:35.865339    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485d9705_f129_465b_8b42_db7bafc309e6.slice/crio-d47ab9a8918d0ddb65f983e3da1f6db9da196f300f28dcb3fda68d4093b89753 WatchSource:0}: Error finding container d47ab9a8918d0ddb65f983e3da1f6db9da196f300f28dcb3fda68d4093b89753: Status 404 returned error can't find the container with id d47ab9a8918d0ddb65f983e3da1f6db9da196f300f28dcb3fda68d4093b89753
Aug 04 00:18:35.867463 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.867431    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:18:35.867529 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.867504    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:18:35.867571 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:35.867560    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:18:36.832016 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:36.831978    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" event={"ID":"485d9705-f129-465b-8b42-db7bafc309e6","Type":"ContainerStarted","Data":"4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40"}
Aug 04 00:18:36.832498 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:36.832050    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" event={"ID":"485d9705-f129-465b-8b42-db7bafc309e6","Type":"ContainerStarted","Data":"d47ab9a8918d0ddb65f983e3da1f6db9da196f300f28dcb3fda68d4093b89753"}
Aug 04 00:18:36.853128 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:36.853074    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" podStartSLOduration=1.853058155 podStartE2EDuration="1.853058155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:18:36.851873806 +0000 UTC m=+2917.738202271" watchObservedRunningTime="2026-08-04 00:18:36.853058155 +0000 UTC m=+2917.739386620"
Aug 04 00:18:37.725949 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:37.725914    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:37.730568 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:37.730541    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:37.836830 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:37.836802    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:37.837805 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:37.837788    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:38.184502 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:38.184414    2568 patch_prober.go:28] interesting pod/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 00:18:38.184502 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:38.184477    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:18:38.718657 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:38.718618    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:38.821451 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:38.821417    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:39.805640 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.805608    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:18:39.847831 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.847738    2568 generic.go:356] "Generic (PLEG): container finished" podID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerID="8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661" exitCode=0
Aug 04 00:18:39.847831 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.847792    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"
Aug 04 00:18:39.848046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.847832    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" event={"ID":"f13b7bd4-04b1-4840-8580-6f41c0ece80c","Type":"ContainerDied","Data":"8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661"}
Aug 04 00:18:39.848046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.847911    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs" event={"ID":"f13b7bd4-04b1-4840-8580-6f41c0ece80c","Type":"ContainerDied","Data":"cda2ccc3e59e693d431265783dfa869a00af4ea962c05eb0dd56959fa246eb8b"}
Aug 04 00:18:39.848046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.847950    2568 scope.go:117] "RemoveContainer" containerID="8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661"
Aug 04 00:18:39.856935 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.856913    2568 scope.go:117] "RemoveContainer" containerID="e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52"
Aug 04 00:18:39.861622 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.861599    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:39.866045 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.866027    2568 scope.go:117] "RemoveContainer" containerID="8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661"
Aug 04 00:18:39.866346 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:18:39.866311    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661\": container with ID starting with 8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661 not found: ID does not exist" containerID="8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661"
Aug 04 00:18:39.866404 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.866354    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661"} err="failed to get container status \"8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661\": rpc error: code = NotFound desc = could not find container \"8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661\": container with ID starting with 8687d74bf82d20f46d9b6e9084ee299543a1393d1873e427b7b3426ab016d661 not found: ID does not exist"
Aug 04 00:18:39.866404 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.866371    2568 scope.go:117] "RemoveContainer" containerID="e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52"
Aug 04 00:18:39.866631 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:18:39.866615    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52\": container with ID starting with e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52 not found: ID does not exist" containerID="e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52"
Aug 04 00:18:39.866682 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.866635    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52"} err="failed to get container status \"e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52\": rpc error: code = NotFound desc = could not find container \"e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52\": container with ID starting with e6d467b393693d02b00c683ac7f090653a3b264ec13bb941e4ad3ce564937c52 not found: ID does not exist"
Aug 04 00:18:39.887986 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.887957    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-envoy\") pod \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") "
Aug 04 00:18:39.888124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888011    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-socket\") pod \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") "
Aug 04 00:18:39.888124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888036    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-podinfo\") pod \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") "
Aug 04 00:18:39.888124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888075    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-token\") pod \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") "
Aug 04 00:18:39.888305 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888147    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-certs\") pod \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") "
Aug 04 00:18:39.888305 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888175    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istiod-ca-cert\") pod \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") "
Aug 04 00:18:39.888305 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888221    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-data\") pod \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") "
Aug 04 00:18:39.888305 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888245    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-credential-socket\") pod \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") "
Aug 04 00:18:39.888515 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888315    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f13b7bd4-04b1-4840-8580-6f41c0ece80c" (UID: "f13b7bd4-04b1-4840-8580-6f41c0ece80c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:18:39.888568 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888512    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f13b7bd4-04b1-4840-8580-6f41c0ece80c" (UID: "f13b7bd4-04b1-4840-8580-6f41c0ece80c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:18:39.888568 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888517    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f13b7bd4-04b1-4840-8580-6f41c0ece80c" (UID: "f13b7bd4-04b1-4840-8580-6f41c0ece80c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:18:39.888568 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888548    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxft7\" (UniqueName: \"kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-kube-api-access-cxft7\") pod \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\" (UID: \"f13b7bd4-04b1-4840-8580-6f41c0ece80c\") "
Aug 04 00:18:39.888708 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888583    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-data" (OuterVolumeSpecName: "istio-data") pod "f13b7bd4-04b1-4840-8580-6f41c0ece80c" (UID: "f13b7bd4-04b1-4840-8580-6f41c0ece80c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:18:39.888708 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888650    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f13b7bd4-04b1-4840-8580-6f41c0ece80c" (UID: "f13b7bd4-04b1-4840-8580-6f41c0ece80c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:18:39.888871 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888853    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:39.888918 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888878    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:39.888918 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888888    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:39.888918 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888896    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:39.888918 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.888906    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:39.890252 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.890230    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f13b7bd4-04b1-4840-8580-6f41c0ece80c" (UID: "f13b7bd4-04b1-4840-8580-6f41c0ece80c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:18:39.890752 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.890730    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f13b7bd4-04b1-4840-8580-6f41c0ece80c" (UID: "f13b7bd4-04b1-4840-8580-6f41c0ece80c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:18:39.890849 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.890758    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-token" (OuterVolumeSpecName: "istio-token") pod "f13b7bd4-04b1-4840-8580-6f41c0ece80c" (UID: "f13b7bd4-04b1-4840-8580-6f41c0ece80c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:18:39.890888 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.890853    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-kube-api-access-cxft7" (OuterVolumeSpecName: "kube-api-access-cxft7") pod "f13b7bd4-04b1-4840-8580-6f41c0ece80c" (UID: "f13b7bd4-04b1-4840-8580-6f41c0ece80c"). InnerVolumeSpecName "kube-api-access-cxft7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:18:39.989615 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.989578    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxft7\" (UniqueName: \"kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-kube-api-access-cxft7\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:39.989797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.989684    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:39.989797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.989700    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:39.989797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:39.989711    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13b7bd4-04b1-4840-8580-6f41c0ece80c-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:18:40.170811 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:40.170778    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"]
Aug 04 00:18:40.178190 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:40.178161    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-35e594-openshift-default-57bc78675b-xk8cs"]
Aug 04 00:18:40.360061 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:40.360030    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:40.458236 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:40.458146    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:18:41.660021 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:41.659986    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" path="/var/lib/kubelet/pods/f13b7bd4-04b1-4840-8580-6f41c0ece80c/volumes"
Aug 04 00:18:42.345707 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:42.345674    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:18:51.906775 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:51.906744    2568 generic.go:356] "Generic (PLEG): container finished" podID="485d9705-f129-465b-8b42-db7bafc309e6" containerID="4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40" exitCode=0
Aug 04 00:18:51.907183 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:51.906813    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" event={"ID":"485d9705-f129-465b-8b42-db7bafc309e6","Type":"ContainerDied","Data":"4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40"}
Aug 04 00:18:51.907230 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:51.907190    2568 scope.go:117] "RemoveContainer" containerID="4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40"
Aug 04 00:18:51.908175 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:51.908147    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:18:51.908239 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:51.908221    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:18:51.908291 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:51.908253    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:18:52.837401 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:52.837361    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:52.918083 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:52.918039    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" event={"ID":"485d9705-f129-465b-8b42-db7bafc309e6","Type":"ContainerStarted","Data":"a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41"}
Aug 04 00:18:53.725416 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:53.725378    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:53.726458 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:53.726436    2568 patch_prober.go:28] interesting pod/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:18:53.726517 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:53.726487    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:18:54.725697 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:54.725664    2568 patch_prober.go:28] interesting pod/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:18:54.726126 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:54.725719    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:18:55.725792 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:55.725759    2568 patch_prober.go:28] interesting pod/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:18:55.726187 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:55.725814    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:18:56.726149 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:56.726111    2568 patch_prober.go:28] interesting pod/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:18:56.726601 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:56.726169    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:18:57.725817 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:57.725776    2568 patch_prober.go:28] interesting pod/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:18:57.725997 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:57.725852    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:18:58.729459 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:58.729426    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:58.729928 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:58.729712    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:18:58.730389 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:18:58.730369    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:19:03.666556 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:03.666512    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:03.982899 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:03.982860    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:04.314115 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.314037    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"]
Aug 04 00:19:04.314404 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.314392    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy"
Aug 04 00:19:04.314458 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.314406    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy"
Aug 04 00:19:04.314458 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.314422    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy"
Aug 04 00:19:04.314458 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.314427    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="70758f71-10ea-487d-acb3-4a2b352e70c3" containerName="istio-proxy"
Aug 04 00:19:04.314458 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.314436    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy"
Aug 04 00:19:04.314458 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.314442    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy"
Aug 04 00:19:04.314610 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.314496    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy"
Aug 04 00:19:04.317432 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.317415    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.319781 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.319761    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-98f978-openshift-default-dockercfg-8r6r7\""
Aug 04 00:19:04.330900 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.330875    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"]
Aug 04 00:19:04.349104 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.349073    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:04.408281 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.408229    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-envoy\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.408472 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.408285    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-data\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.408472 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.408324    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istiod-ca-cert\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.408472 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.408351    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8xzq\" (UniqueName: \"kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-kube-api-access-l8xzq\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.408472 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.408384    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-certs\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.408472 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.408437    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-socket\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.408718 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.408509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-podinfo\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.408718 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.408545    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-credential-socket\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.408718 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.408606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-token\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.509537 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.509494    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8xzq\" (UniqueName: \"kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-kube-api-access-l8xzq\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.509537 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.509543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-certs\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.509787 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.509568    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-socket\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.509787 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.509615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-podinfo\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.509787 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.509635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-credential-socket\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.509787 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.509669    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-token\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.509787 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.509685    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-envoy\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.509787 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.509700    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-data\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.509787 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.509723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istiod-ca-cert\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.510153 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.510128    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-socket\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.510244 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.510211    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-credential-socket\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.510333 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.510290    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-certs\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.510388 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.510366    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-data\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.510540 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.510515    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istiod-ca-cert\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.512295 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.512275    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-envoy\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.512517 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.512499    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-podinfo\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.517471 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.517449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-token\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.517597 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.517579    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8xzq\" (UniqueName: \"kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-kube-api-access-l8xzq\") pod \"e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") " pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.628427 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.628343    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:04.699916 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.699854    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:04.779172 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.779146    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"]
Aug 04 00:19:04.781627 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:19:04.781603    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98caa13_e8ae_4ccc_a18a_35f0172d4787.slice/crio-14b5468eceef58199e9d0b7e9c0ec1132cd094c944726abe08e6afb0fcd1e2f6 WatchSource:0}: Error finding container 14b5468eceef58199e9d0b7e9c0ec1132cd094c944726abe08e6afb0fcd1e2f6: Status 404 returned error can't find the container with id 14b5468eceef58199e9d0b7e9c0ec1132cd094c944726abe08e6afb0fcd1e2f6
Aug 04 00:19:04.783737 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.783698    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:19:04.783833 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.783774    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:19:04.783874 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.783835    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:19:04.978690 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.978655    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" event={"ID":"d98caa13-e8ae-4ccc-a18a-35f0172d4787","Type":"ContainerStarted","Data":"bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0"}
Aug 04 00:19:04.978885 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.978715    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" event={"ID":"d98caa13-e8ae-4ccc-a18a-35f0172d4787","Type":"ContainerStarted","Data":"14b5468eceef58199e9d0b7e9c0ec1132cd094c944726abe08e6afb0fcd1e2f6"}
Aug 04 00:19:04.997778 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:04.997717    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" podStartSLOduration=0.997698734 podStartE2EDuration="997.698734ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:19:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:19:04.995031733 +0000 UTC m=+2945.881360200" watchObservedRunningTime="2026-08-04 00:19:04.997698734 +0000 UTC m=+2945.884027199"
Aug 04 00:19:05.628679 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:05.628640    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:05.634036 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:05.634005    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:05.983812 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:05.983771    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:05.984741 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:05.984724    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:06.892705 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:06.892667    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:06.994985 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:06.994931    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:08.058364 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:08.058322    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:08.570121 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:08.570082    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:08.695357 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:08.695322    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:08.775706 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:08.775671    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:11.144166 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:11.144132    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:19:20.985547 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:20.985508    2568 patch_prober.go:28] interesting pod/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 00:19:20.985939 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:20.985565    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 00:19:21.064511 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:21.064417    2568 generic.go:356] "Generic (PLEG): container finished" podID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerID="bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0" exitCode=0
Aug 04 00:19:21.064511 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:21.064460    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" event={"ID":"d98caa13-e8ae-4ccc-a18a-35f0172d4787","Type":"ContainerDied","Data":"bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0"}
Aug 04 00:19:21.064901 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:21.064883    2568 scope.go:117] "RemoveContainer" containerID="bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0"
Aug 04 00:19:21.065905 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:21.065875    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:19:21.065996 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:21.065964    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:19:21.066058 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:21.066014    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:19:22.071530 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:22.071492    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" event={"ID":"d98caa13-e8ae-4ccc-a18a-35f0172d4787","Type":"ContainerStarted","Data":"abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed"}
Aug 04 00:19:22.629447 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:22.629407    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:22.629672 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:22.629630    2568 patch_prober.go:28] interesting pod/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 00:19:22.629721 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:22.629678    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 00:19:23.628804 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:23.628763    2568 patch_prober.go:28] interesting pod/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 00:19:23.629203 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:23.628820    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 00:19:24.629514 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:24.629473    2568 patch_prober.go:28] interesting pod/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 00:19:24.629930 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:24.629548    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 00:19:25.628938 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:25.628895    2568 patch_prober.go:28] interesting pod/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 00:19:25.629121 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:25.628962    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 00:19:26.628989 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:26.628955    2568 patch_prober.go:28] interesting pod/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 00:19:26.629481 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:26.629013    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 00:19:27.633501 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:27.633469    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:27.633892 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:27.633791    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:27.634622 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:27.634604    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:19:31.854674 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:31.854635    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:41.446544 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.446503    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"]
Aug 04 00:19:41.446961 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.446910    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13b7bd4-04b1-4840-8580-6f41c0ece80c" containerName="istio-proxy"
Aug 04 00:19:41.448910 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.448882    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.451955 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.451927    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1769a3\"/\"kube-root-ca.crt\""
Aug 04 00:19:41.451955 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.451947    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1769a3\"/\"default-dockercfg-4jqnj\""
Aug 04 00:19:41.452142 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.451962    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1769a3\"/\"openshift-service-ca.crt\""
Aug 04 00:19:41.452142 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.451962    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1769a3\"/\"auth-test-model-1769a3-kserve-self-signed-certs\""
Aug 04 00:19:41.457790 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.457765    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"]
Aug 04 00:19:41.561695 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.561656    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-home\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.561920 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.561733    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-tmp-dir\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.561920 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.561763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-dshm\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.561920 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.561783    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-model-cache\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.561920 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.561808    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f71331-3f60-4b28-8920-3a0d514495b4-tls-certs\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.561920 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.561868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wr84\" (UniqueName: \"kubernetes.io/projected/d6f71331-3f60-4b28-8920-3a0d514495b4-kube-api-access-4wr84\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.641480 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.641415    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:19:41.662371 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.662336    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-home\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.662549 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.662414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-tmp-dir\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.662549 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.662431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-dshm\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.662549 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.662453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-model-cache\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.662549 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.662480    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f71331-3f60-4b28-8920-3a0d514495b4-tls-certs\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.662549 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.662495    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wr84\" (UniqueName: \"kubernetes.io/projected/d6f71331-3f60-4b28-8920-3a0d514495b4-kube-api-access-4wr84\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.662825 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.662787    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-home\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.662883 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.662824    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-model-cache\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.662883 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.662849    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-tmp-dir\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.664925 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.664895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-dshm\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.665089 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.665072    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f71331-3f60-4b28-8920-3a0d514495b4-tls-certs\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.671274 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.671231    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wr84\" (UniqueName: \"kubernetes.io/projected/d6f71331-3f60-4b28-8920-3a0d514495b4-kube-api-access-4wr84\") pod \"auth-test-model-1769a3-kserve-565594d49f-cfjb8\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") " pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.760027 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.759986    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:41.906300 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:41.906231    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"]
Aug 04 00:19:41.909519 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:19:41.909483    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6f71331_3f60_4b28_8920_3a0d514495b4.slice/crio-54ad38625e634c7b3d25ff523b672d158acfde94d7fd81b520836b8e74cd77c4 WatchSource:0}: Error finding container 54ad38625e634c7b3d25ff523b672d158acfde94d7fd81b520836b8e74cd77c4: Status 404 returned error can't find the container with id 54ad38625e634c7b3d25ff523b672d158acfde94d7fd81b520836b8e74cd77c4
Aug 04 00:19:42.172716 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:42.172627    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8" event={"ID":"d6f71331-3f60-4b28-8920-3a0d514495b4","Type":"ContainerStarted","Data":"e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff"}
Aug 04 00:19:42.172716 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:42.172666    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8" event={"ID":"d6f71331-3f60-4b28-8920-3a0d514495b4","Type":"ContainerStarted","Data":"54ad38625e634c7b3d25ff523b672d158acfde94d7fd81b520836b8e74cd77c4"}
Aug 04 00:19:42.191410 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:42.191360    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8" podStartSLOduration=1.191343606 podStartE2EDuration="1.191343606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:19:42.188441508 +0000 UTC m=+2983.074769972" watchObservedRunningTime="2026-08-04 00:19:42.191343606 +0000 UTC m=+2983.077672070"
Aug 04 00:19:44.151675 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:44.151587    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:19:51.760371 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:51.760330    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:51.760371 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:51.760383    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:51.772848 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:51.772818    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:19:52.231948 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:19:52.231919    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:20:05.251101 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.251061    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"]
Aug 04 00:20:05.254794 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.254769    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.258219 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.258199    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"default-dockercfg-wgkhz\""
Aug 04 00:20:05.258397 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.258240    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"openshift-service-ca.crt\""
Aug 04 00:20:05.258397 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.258307    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"kube-root-ca.crt\""
Aug 04 00:20:05.258397 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.258240    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"auth-test-model-98f978-kserve-self-signed-certs\""
Aug 04 00:20:05.263232 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.263208    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"]
Aug 04 00:20:05.280984 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.280957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:20:05.368735 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.368699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1072c7c8-e114-4285-8849-72370e7f579d-tls-certs\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.368929 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.368755    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jblr8\" (UniqueName: \"kubernetes.io/projected/1072c7c8-e114-4285-8849-72370e7f579d-kube-api-access-jblr8\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.368929 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.368811    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-home\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.368929 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.368846    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-model-cache\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.368929 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.368876    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-tmp-dir\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.368929 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.368904    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-dshm\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.469349 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.469316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-tmp-dir\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.469551 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.469365    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-dshm\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.469551 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.469413    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1072c7c8-e114-4285-8849-72370e7f579d-tls-certs\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.469551 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.469448    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jblr8\" (UniqueName: \"kubernetes.io/projected/1072c7c8-e114-4285-8849-72370e7f579d-kube-api-access-jblr8\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.469734 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.469603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-home\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.469734 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.469660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-model-cache\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.469734 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.469712    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-tmp-dir\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.469922 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.469888    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-home\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.470021 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.470001    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-model-cache\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.471746 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.471724    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-dshm\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.472002 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.471984    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1072c7c8-e114-4285-8849-72370e7f579d-tls-certs\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.477598 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.477578    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jblr8\" (UniqueName: \"kubernetes.io/projected/1072c7c8-e114-4285-8849-72370e7f579d-kube-api-access-jblr8\") pod \"auth-test-model-98f978-kserve-95c9b48c-c8565\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") " pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.566375 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.566243    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:05.704535 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.704504    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"]
Aug 04 00:20:05.706746 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:20:05.706712    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1072c7c8_e114_4285_8849_72370e7f579d.slice/crio-1cbd9af9ece31223ef6cc9af9b9e71869255f851b40626f79072fc4851fb0026 WatchSource:0}: Error finding container 1cbd9af9ece31223ef6cc9af9b9e71869255f851b40626f79072fc4851fb0026: Status 404 returned error can't find the container with id 1cbd9af9ece31223ef6cc9af9b9e71869255f851b40626f79072fc4851fb0026
Aug 04 00:20:05.734777 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:05.734739    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:20:06.301474 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:06.301434    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565" event={"ID":"1072c7c8-e114-4285-8849-72370e7f579d","Type":"ContainerStarted","Data":"3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d"}
Aug 04 00:20:06.301474 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:06.301480    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565" event={"ID":"1072c7c8-e114-4285-8849-72370e7f579d","Type":"ContainerStarted","Data":"1cbd9af9ece31223ef6cc9af9b9e71869255f851b40626f79072fc4851fb0026"}
Aug 04 00:20:06.319305 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:06.319232    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565" podStartSLOduration=1.319217819 podStartE2EDuration="1.319217819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:20:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:20:06.316808361 +0000 UTC m=+3007.203136826" watchObservedRunningTime="2026-08-04 00:20:06.319217819 +0000 UTC m=+3007.205546283"
Aug 04 00:20:07.141930 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:07.141889    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:20:15.566807 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:15.566762    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:15.567325 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:15.566822    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:15.579855 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:15.579833    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:16.364470 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:16.364436    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:20:37.140960 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:37.140921    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:20:52.553752 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:20:52.553664    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:21:03.993527 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:21:03.993492    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:21:04.648023 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:21:04.647986    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:21:17.976761 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:21:17.976711    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:21:19.242974 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:21:19.242940    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:21:30.749138 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:21:30.749100    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:21:42.557035 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:21:42.556999    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:21:42.657966 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:21:42.657935    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:21:45.442573 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:21:45.442533    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:21:56.341651 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:21:56.341612    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:22:11.743857 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:22:11.743799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:22:22.961824 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:22:22.961725    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:22:38.054384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:22:38.054351    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:22:50.242404 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:22:50.242361    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:22:58.280958 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:22:58.280903    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:22:58.384403 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:22:58.384366    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:23:04.536578 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:04.536541    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:23:08.540776 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:08.540744    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"]
Aug 04 00:23:08.563615 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:08.563582    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:23:09.430857 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:09.430817    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"]
Aug 04 00:23:09.450928 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:09.450893    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:23:14.844550 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:14.844513    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:23:23.564031 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.563975    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8" podUID="d6f71331-3f60-4b28-8920-3a0d514495b4" containerName="main" containerID="cri-o://e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff" gracePeriod=45
Aug 04 00:23:23.821621 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.821551    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:23:23.839181 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.839152    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wr84\" (UniqueName: \"kubernetes.io/projected/d6f71331-3f60-4b28-8920-3a0d514495b4-kube-api-access-4wr84\") pod \"d6f71331-3f60-4b28-8920-3a0d514495b4\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") "
Aug 04 00:23:23.839345 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.839220    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f71331-3f60-4b28-8920-3a0d514495b4-tls-certs\") pod \"d6f71331-3f60-4b28-8920-3a0d514495b4\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") "
Aug 04 00:23:23.839345 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.839317    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-tmp-dir\") pod \"d6f71331-3f60-4b28-8920-3a0d514495b4\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") "
Aug 04 00:23:23.839712 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.839352    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-home\") pod \"d6f71331-3f60-4b28-8920-3a0d514495b4\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") "
Aug 04 00:23:23.839881 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.839599    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d6f71331-3f60-4b28-8920-3a0d514495b4" (UID: "d6f71331-3f60-4b28-8920-3a0d514495b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:23:23.839881 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.839687    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-home" (OuterVolumeSpecName: "home") pod "d6f71331-3f60-4b28-8920-3a0d514495b4" (UID: "d6f71331-3f60-4b28-8920-3a0d514495b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:23:23.841318 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.841032    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-dshm\") pod \"d6f71331-3f60-4b28-8920-3a0d514495b4\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") "
Aug 04 00:23:23.841318 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.841135    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-model-cache\") pod \"d6f71331-3f60-4b28-8920-3a0d514495b4\" (UID: \"d6f71331-3f60-4b28-8920-3a0d514495b4\") "
Aug 04 00:23:23.841782 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.841727    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-tmp-dir\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:23.841782 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.841758    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-home\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:23.842251 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.842212    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "d6f71331-3f60-4b28-8920-3a0d514495b4" (UID: "d6f71331-3f60-4b28-8920-3a0d514495b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:23:23.842645 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.842612    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6f71331-3f60-4b28-8920-3a0d514495b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d6f71331-3f60-4b28-8920-3a0d514495b4" (UID: "d6f71331-3f60-4b28-8920-3a0d514495b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:23:23.842854 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.842836    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-dshm" (OuterVolumeSpecName: "dshm") pod "d6f71331-3f60-4b28-8920-3a0d514495b4" (UID: "d6f71331-3f60-4b28-8920-3a0d514495b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:23:23.842920 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.842846    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6f71331-3f60-4b28-8920-3a0d514495b4-kube-api-access-4wr84" (OuterVolumeSpecName: "kube-api-access-4wr84") pod "d6f71331-3f60-4b28-8920-3a0d514495b4" (UID: "d6f71331-3f60-4b28-8920-3a0d514495b4"). InnerVolumeSpecName "kube-api-access-4wr84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:23:23.942285 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.942224    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-model-cache\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:23.942285 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.942255    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wr84\" (UniqueName: \"kubernetes.io/projected/d6f71331-3f60-4b28-8920-3a0d514495b4-kube-api-access-4wr84\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:23.942285 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.942292    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f71331-3f60-4b28-8920-3a0d514495b4-tls-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:23.942546 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:23.942304    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f71331-3f60-4b28-8920-3a0d514495b4-dshm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:24.278825 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.278788    2568 generic.go:356] "Generic (PLEG): container finished" podID="d6f71331-3f60-4b28-8920-3a0d514495b4" containerID="e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff" exitCode=0
Aug 04 00:23:24.278825 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.278827    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"
Aug 04 00:23:24.279030 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.278843    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8" event={"ID":"d6f71331-3f60-4b28-8920-3a0d514495b4","Type":"ContainerDied","Data":"e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff"}
Aug 04 00:23:24.279030 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.278883    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8" event={"ID":"d6f71331-3f60-4b28-8920-3a0d514495b4","Type":"ContainerDied","Data":"54ad38625e634c7b3d25ff523b672d158acfde94d7fd81b520836b8e74cd77c4"}
Aug 04 00:23:24.279030 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.278901    2568 scope.go:117] "RemoveContainer" containerID="e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff"
Aug 04 00:23:24.288388 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.288367    2568 scope.go:117] "RemoveContainer" containerID="e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff"
Aug 04 00:23:24.288677 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:23:24.288654    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff\": container with ID starting with e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff not found: ID does not exist" containerID="e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff"
Aug 04 00:23:24.288747 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.288684    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff"} err="failed to get container status \"e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff\": rpc error: code = NotFound desc = could not find container \"e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff\": container with ID starting with e357c82d33462015f633795e91cf99d3850d0ee3a26e147511252c96ee16faff not found: ID does not exist"
Aug 04 00:23:24.300096 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.300071    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"]
Aug 04 00:23:24.303274 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.303235    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/auth-test-model-1769a3-kserve-565594d49f-cfjb8"]
Aug 04 00:23:24.450815 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.450769    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565" podUID="1072c7c8-e114-4285-8849-72370e7f579d" containerName="main" containerID="cri-o://3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d" gracePeriod=45
Aug 04 00:23:24.699783 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.699755    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:23:24.750406 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.750373    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-model-cache\") pod \"1072c7c8-e114-4285-8849-72370e7f579d\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") "
Aug 04 00:23:24.750583 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.750416    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-home\") pod \"1072c7c8-e114-4285-8849-72370e7f579d\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") "
Aug 04 00:23:24.750583 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.750442    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1072c7c8-e114-4285-8849-72370e7f579d-tls-certs\") pod \"1072c7c8-e114-4285-8849-72370e7f579d\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") "
Aug 04 00:23:24.750583 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.750506    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jblr8\" (UniqueName: \"kubernetes.io/projected/1072c7c8-e114-4285-8849-72370e7f579d-kube-api-access-jblr8\") pod \"1072c7c8-e114-4285-8849-72370e7f579d\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") "
Aug 04 00:23:24.750744 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.750655    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-tmp-dir\") pod \"1072c7c8-e114-4285-8849-72370e7f579d\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") "
Aug 04 00:23:24.750744 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.750670    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-model-cache" (OuterVolumeSpecName: "model-cache") pod "1072c7c8-e114-4285-8849-72370e7f579d" (UID: "1072c7c8-e114-4285-8849-72370e7f579d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:23:24.750744 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.750700    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-home" (OuterVolumeSpecName: "home") pod "1072c7c8-e114-4285-8849-72370e7f579d" (UID: "1072c7c8-e114-4285-8849-72370e7f579d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:23:24.750744 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.750708    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-dshm\") pod \"1072c7c8-e114-4285-8849-72370e7f579d\" (UID: \"1072c7c8-e114-4285-8849-72370e7f579d\") "
Aug 04 00:23:24.750925 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.750854    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1072c7c8-e114-4285-8849-72370e7f579d" (UID: "1072c7c8-e114-4285-8849-72370e7f579d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:23:24.751077 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.751058    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-tmp-dir\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:24.751143 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.751082    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-model-cache\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:24.751143 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.751096    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-home\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:24.752850 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.752822    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1072c7c8-e114-4285-8849-72370e7f579d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1072c7c8-e114-4285-8849-72370e7f579d" (UID: "1072c7c8-e114-4285-8849-72370e7f579d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:23:24.753220 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.753191    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-dshm" (OuterVolumeSpecName: "dshm") pod "1072c7c8-e114-4285-8849-72370e7f579d" (UID: "1072c7c8-e114-4285-8849-72370e7f579d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:23:24.753220 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.753210    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1072c7c8-e114-4285-8849-72370e7f579d-kube-api-access-jblr8" (OuterVolumeSpecName: "kube-api-access-jblr8") pod "1072c7c8-e114-4285-8849-72370e7f579d" (UID: "1072c7c8-e114-4285-8849-72370e7f579d"). InnerVolumeSpecName "kube-api-access-jblr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:23:24.852439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.852350    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jblr8\" (UniqueName: \"kubernetes.io/projected/1072c7c8-e114-4285-8849-72370e7f579d-kube-api-access-jblr8\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:24.852439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.852379    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1072c7c8-e114-4285-8849-72370e7f579d-dshm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:24.852439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:24.852389    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1072c7c8-e114-4285-8849-72370e7f579d-tls-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:23:25.288070 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.288034    2568 generic.go:356] "Generic (PLEG): container finished" podID="1072c7c8-e114-4285-8849-72370e7f579d" containerID="3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d" exitCode=0
Aug 04 00:23:25.288251 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.288079    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"
Aug 04 00:23:25.288251 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.288097    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565" event={"ID":"1072c7c8-e114-4285-8849-72370e7f579d","Type":"ContainerDied","Data":"3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d"}
Aug 04 00:23:25.288251 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.288127    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565" event={"ID":"1072c7c8-e114-4285-8849-72370e7f579d","Type":"ContainerDied","Data":"1cbd9af9ece31223ef6cc9af9b9e71869255f851b40626f79072fc4851fb0026"}
Aug 04 00:23:25.288251 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.288144    2568 scope.go:117] "RemoveContainer" containerID="3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d"
Aug 04 00:23:25.297445 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.297422    2568 scope.go:117] "RemoveContainer" containerID="3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d"
Aug 04 00:23:25.297705 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:23:25.297677    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d\": container with ID starting with 3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d not found: ID does not exist" containerID="3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d"
Aug 04 00:23:25.297770 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.297706    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d"} err="failed to get container status \"3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d\": rpc error: code = NotFound desc = could not find container \"3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d\": container with ID starting with 3a4b7ab14f6c7539dfe4bd896675909cab1f673bf744e51b7fcfd81704ef5a2d not found: ID does not exist"
Aug 04 00:23:25.309962 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.309933    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"]
Aug 04 00:23:25.314671 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.314647    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/auth-test-model-98f978-kserve-95c9b48c-c8565"]
Aug 04 00:23:25.660773 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.660689    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1072c7c8-e114-4285-8849-72370e7f579d" path="/var/lib/kubelet/pods/1072c7c8-e114-4285-8849-72370e7f579d/volumes"
Aug 04 00:23:25.661072 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:25.661059    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6f71331-3f60-4b28-8920-3a0d514495b4" path="/var/lib/kubelet/pods/d6f71331-3f60-4b28-8920-3a0d514495b4/volumes"
Aug 04 00:23:28.471161 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.471128    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"]
Aug 04 00:23:28.471585 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.471558    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6f71331-3f60-4b28-8920-3a0d514495b4" containerName="main"
Aug 04 00:23:28.471585 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.471577    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6f71331-3f60-4b28-8920-3a0d514495b4" containerName="main"
Aug 04 00:23:28.471686 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.471613    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1072c7c8-e114-4285-8849-72370e7f579d" containerName="main"
Aug 04 00:23:28.471686 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.471624    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1072c7c8-e114-4285-8849-72370e7f579d" containerName="main"
Aug 04 00:23:28.471750 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.471716    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6f71331-3f60-4b28-8920-3a0d514495b4" containerName="main"
Aug 04 00:23:28.471750 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.471734    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1072c7c8-e114-4285-8849-72370e7f579d" containerName="main"
Aug 04 00:23:28.473740 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.473715    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:23:28.476293 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.476274    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.480098 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.480074    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1769a3\"/\"kube-root-ca.crt\""
Aug 04 00:23:28.480399 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.480097    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1769a3\"/\"default-dockercfg-4jqnj\""
Aug 04 00:23:28.480584 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.480559    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1769a3\"/\"sub-test-model-1769a3-kserve-self-signed-certs\""
Aug 04 00:23:28.480698 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.480586    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1769a3\"/\"openshift-service-ca.crt\""
Aug 04 00:23:28.482581 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.482555    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"]
Aug 04 00:23:28.588454 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.588420    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58fdcb9b-fde6-4e81-8a75-17625dff381e-tls-certs\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.588663 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.588466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-dshm\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.588663 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.588540    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-home\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.588663 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.588612    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-tmp-dir\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.588803 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.588690    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-model-cache\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.588803 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.588712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlslx\" (UniqueName: \"kubernetes.io/projected/58fdcb9b-fde6-4e81-8a75-17625dff381e-kube-api-access-nlslx\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.690135 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.690088    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-tmp-dir\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.690379 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.690190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-model-cache\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.690379 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.690208    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlslx\" (UniqueName: \"kubernetes.io/projected/58fdcb9b-fde6-4e81-8a75-17625dff381e-kube-api-access-nlslx\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.690379 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.690242    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58fdcb9b-fde6-4e81-8a75-17625dff381e-tls-certs\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.690379 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.690345    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-dshm\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.690630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.690409    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-home\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.690630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.690583    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-tmp-dir\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.690630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.690621    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-model-cache\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.690852 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.690828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-home\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.692929 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.692898    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-dshm\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.693333 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.693314    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58fdcb9b-fde6-4e81-8a75-17625dff381e-tls-certs\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.699119 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.699093    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlslx\" (UniqueName: \"kubernetes.io/projected/58fdcb9b-fde6-4e81-8a75-17625dff381e-kube-api-access-nlslx\") pod \"sub-test-model-1769a3-kserve-99b988777-lm5tg\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") " pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.788243 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.788159    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:28.925140 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:28.925102    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"]
Aug 04 00:23:28.928620 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:23:28.928593    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58fdcb9b_fde6_4e81_8a75_17625dff381e.slice/crio-1a642766ad8f4aa75fc4c14134e2e4c1afd53d35c8d9209bbc8fd2f1fc6f541e WatchSource:0}: Error finding container 1a642766ad8f4aa75fc4c14134e2e4c1afd53d35c8d9209bbc8fd2f1fc6f541e: Status 404 returned error can't find the container with id 1a642766ad8f4aa75fc4c14134e2e4c1afd53d35c8d9209bbc8fd2f1fc6f541e
Aug 04 00:23:29.310660 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:29.310623    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg" event={"ID":"58fdcb9b-fde6-4e81-8a75-17625dff381e","Type":"ContainerStarted","Data":"19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c"}
Aug 04 00:23:29.310837 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:29.310676    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg" event={"ID":"58fdcb9b-fde6-4e81-8a75-17625dff381e","Type":"ContainerStarted","Data":"1a642766ad8f4aa75fc4c14134e2e4c1afd53d35c8d9209bbc8fd2f1fc6f541e"}
Aug 04 00:23:29.327933 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:29.327881    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg" podStartSLOduration=1.327865389 podStartE2EDuration="1.327865389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:23:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:23:29.326421565 +0000 UTC m=+3210.212750029" watchObservedRunningTime="2026-08-04 00:23:29.327865389 +0000 UTC m=+3210.214193856"
Aug 04 00:23:30.842093 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:30.842055    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:23:38.788367 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:38.788329    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:38.788799 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:38.788644    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:38.801058 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:38.801032    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:39.379569 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:39.379540    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:23:45.347531 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.347496    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"]
Aug 04 00:23:45.351327 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.351303    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.353555 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.353527    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"openshift-service-ca.crt\""
Aug 04 00:23:45.353699 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.353682    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"kube-root-ca.crt\""
Aug 04 00:23:45.354604 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.354583    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"default-dockercfg-wgkhz\""
Aug 04 00:23:45.354734 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.354613    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"sub-test-model-98f978-kserve-self-signed-certs\""
Aug 04 00:23:45.359926 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.359900    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"]
Aug 04 00:23:45.373233 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.373197    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:23:45.446384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.446337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-tmp-dir\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.446575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.446397    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b18342-83fa-4537-b2a1-e8a95d76a66b-tls-certs\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.446575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.446427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-dshm\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.446575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.446446    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tztcg\" (UniqueName: \"kubernetes.io/projected/26b18342-83fa-4537-b2a1-e8a95d76a66b-kube-api-access-tztcg\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.446575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.446469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-home\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.446575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.446498    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-model-cache\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.547414 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.547375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b18342-83fa-4537-b2a1-e8a95d76a66b-tls-certs\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.547633 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.547426    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-dshm\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.547633 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.547458    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tztcg\" (UniqueName: \"kubernetes.io/projected/26b18342-83fa-4537-b2a1-e8a95d76a66b-kube-api-access-tztcg\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.547633 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.547494    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-home\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.547633 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.547541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-model-cache\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.547633 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.547627    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-tmp-dir\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.548018 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.547991    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-home\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.548126 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.547998    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-model-cache\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.548126 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.548042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-tmp-dir\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.549884 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.549865    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-dshm\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.550057 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.550041    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b18342-83fa-4537-b2a1-e8a95d76a66b-tls-certs\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.556604 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.556581    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tztcg\" (UniqueName: \"kubernetes.io/projected/26b18342-83fa-4537-b2a1-e8a95d76a66b-kube-api-access-tztcg\") pod \"sub-test-model-98f978-kserve-569d9d644f-hrvxl\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") " pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.661998 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.661923    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:45.800668 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:45.800607    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"]
Aug 04 00:23:45.803061 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:23:45.803030    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26b18342_83fa_4537_b2a1_e8a95d76a66b.slice/crio-3a59dd9982ff239b42c1ee8b0436e8a498d98865f9421223823597352b988b23 WatchSource:0}: Error finding container 3a59dd9982ff239b42c1ee8b0436e8a498d98865f9421223823597352b988b23: Status 404 returned error can't find the container with id 3a59dd9982ff239b42c1ee8b0436e8a498d98865f9421223823597352b988b23
Aug 04 00:23:46.403657 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:46.403618    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl" event={"ID":"26b18342-83fa-4537-b2a1-e8a95d76a66b","Type":"ContainerStarted","Data":"c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf"}
Aug 04 00:23:46.403657 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:46.403661    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl" event={"ID":"26b18342-83fa-4537-b2a1-e8a95d76a66b","Type":"ContainerStarted","Data":"3a59dd9982ff239b42c1ee8b0436e8a498d98865f9421223823597352b988b23"}
Aug 04 00:23:46.421153 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:46.421094    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl" podStartSLOduration=1.42107272 podStartE2EDuration="1.42107272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:23:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:23:46.420125096 +0000 UTC m=+3227.306453562" watchObservedRunningTime="2026-08-04 00:23:46.42107272 +0000 UTC m=+3227.307401186"
Aug 04 00:23:47.946913 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:47.946877    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:23:55.662328 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:55.662228    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:55.662785 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:55.662489    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:55.675070 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:55.675046    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:23:56.463319 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:23:56.463291    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:24:21.552396 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:24:21.552352    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:24:32.358368 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:24:32.358327    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:25:00.446119 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:00.446080    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:25:05.103133 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:05.103093    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"]
Aug 04 00:25:05.806605 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:05.806570    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:25:06.134460 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:06.134370    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"]
Aug 04 00:25:06.155700 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:06.155669    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:25:11.538857 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:11.538818    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:25:17.468773 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:17.468732    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:25:20.053229 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.053135    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:25:20.124749 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.124705    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg" podUID="58fdcb9b-fde6-4e81-8a75-17625dff381e" containerName="main" containerID="cri-o://19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c" gracePeriod=45
Aug 04 00:25:20.378802 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.378777    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:25:20.457324 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457248    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-home\") pod \"58fdcb9b-fde6-4e81-8a75-17625dff381e\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") "
Aug 04 00:25:20.457506 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457341    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-tmp-dir\") pod \"58fdcb9b-fde6-4e81-8a75-17625dff381e\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") "
Aug 04 00:25:20.457506 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457415    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-dshm\") pod \"58fdcb9b-fde6-4e81-8a75-17625dff381e\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") "
Aug 04 00:25:20.457506 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457474    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlslx\" (UniqueName: \"kubernetes.io/projected/58fdcb9b-fde6-4e81-8a75-17625dff381e-kube-api-access-nlslx\") pod \"58fdcb9b-fde6-4e81-8a75-17625dff381e\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") "
Aug 04 00:25:20.457506 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457497    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58fdcb9b-fde6-4e81-8a75-17625dff381e-tls-certs\") pod \"58fdcb9b-fde6-4e81-8a75-17625dff381e\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") "
Aug 04 00:25:20.457727 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457513    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-model-cache\") pod \"58fdcb9b-fde6-4e81-8a75-17625dff381e\" (UID: \"58fdcb9b-fde6-4e81-8a75-17625dff381e\") "
Aug 04 00:25:20.457727 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457546    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-home" (OuterVolumeSpecName: "home") pod "58fdcb9b-fde6-4e81-8a75-17625dff381e" (UID: "58fdcb9b-fde6-4e81-8a75-17625dff381e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:25:20.457727 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457561    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58fdcb9b-fde6-4e81-8a75-17625dff381e" (UID: "58fdcb9b-fde6-4e81-8a75-17625dff381e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:25:20.457877 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457773    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-home\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:20.457877 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457790    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-tmp-dir\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:20.457877 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.457833    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-model-cache" (OuterVolumeSpecName: "model-cache") pod "58fdcb9b-fde6-4e81-8a75-17625dff381e" (UID: "58fdcb9b-fde6-4e81-8a75-17625dff381e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:25:20.459716 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.459686    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-dshm" (OuterVolumeSpecName: "dshm") pod "58fdcb9b-fde6-4e81-8a75-17625dff381e" (UID: "58fdcb9b-fde6-4e81-8a75-17625dff381e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:25:20.459836 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.459720    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58fdcb9b-fde6-4e81-8a75-17625dff381e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58fdcb9b-fde6-4e81-8a75-17625dff381e" (UID: "58fdcb9b-fde6-4e81-8a75-17625dff381e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:25:20.459836 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.459774    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58fdcb9b-fde6-4e81-8a75-17625dff381e-kube-api-access-nlslx" (OuterVolumeSpecName: "kube-api-access-nlslx") pod "58fdcb9b-fde6-4e81-8a75-17625dff381e" (UID: "58fdcb9b-fde6-4e81-8a75-17625dff381e"). InnerVolumeSpecName "kube-api-access-nlslx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:25:20.558457 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.558420    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-dshm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:20.558457 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.558453    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlslx\" (UniqueName: \"kubernetes.io/projected/58fdcb9b-fde6-4e81-8a75-17625dff381e-kube-api-access-nlslx\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:20.558457 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.558467    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58fdcb9b-fde6-4e81-8a75-17625dff381e-tls-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:20.558702 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.558476    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58fdcb9b-fde6-4e81-8a75-17625dff381e-model-cache\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:20.865724 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.865686    2568 generic.go:356] "Generic (PLEG): container finished" podID="58fdcb9b-fde6-4e81-8a75-17625dff381e" containerID="19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c" exitCode=0
Aug 04 00:25:20.865926 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.865733    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"
Aug 04 00:25:20.865926 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.865735    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg" event={"ID":"58fdcb9b-fde6-4e81-8a75-17625dff381e","Type":"ContainerDied","Data":"19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c"}
Aug 04 00:25:20.865926 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.865848    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg" event={"ID":"58fdcb9b-fde6-4e81-8a75-17625dff381e","Type":"ContainerDied","Data":"1a642766ad8f4aa75fc4c14134e2e4c1afd53d35c8d9209bbc8fd2f1fc6f541e"}
Aug 04 00:25:20.865926 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.865870    2568 scope.go:117] "RemoveContainer" containerID="19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c"
Aug 04 00:25:20.874802 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.874787    2568 scope.go:117] "RemoveContainer" containerID="19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c"
Aug 04 00:25:20.875052 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:25:20.875038    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c\": container with ID starting with 19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c not found: ID does not exist" containerID="19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c"
Aug 04 00:25:20.875096 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.875059    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c"} err="failed to get container status \"19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c\": rpc error: code = NotFound desc = could not find container \"19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c\": container with ID starting with 19a1a5c4e8278d3f9119e91aa0fd7650505bc121fe91b0c2f73a46fca85da54c not found: ID does not exist"
Aug 04 00:25:20.885808 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.885784    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"]
Aug 04 00:25:20.890677 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:20.890648    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1769a3/sub-test-model-1769a3-kserve-99b988777-lm5tg"]
Aug 04 00:25:21.154626 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.154535    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl" podUID="26b18342-83fa-4537-b2a1-e8a95d76a66b" containerName="main" containerID="cri-o://c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf" gracePeriod=45
Aug 04 00:25:21.415094 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.415022    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:25:21.466858 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.466822    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b18342-83fa-4537-b2a1-e8a95d76a66b-tls-certs\") pod \"26b18342-83fa-4537-b2a1-e8a95d76a66b\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") "
Aug 04 00:25:21.467053 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.466897    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-model-cache\") pod \"26b18342-83fa-4537-b2a1-e8a95d76a66b\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") "
Aug 04 00:25:21.467053 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.466919    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-dshm\") pod \"26b18342-83fa-4537-b2a1-e8a95d76a66b\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") "
Aug 04 00:25:21.467053 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.466943    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-home\") pod \"26b18342-83fa-4537-b2a1-e8a95d76a66b\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") "
Aug 04 00:25:21.467053 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.466985    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-tmp-dir\") pod \"26b18342-83fa-4537-b2a1-e8a95d76a66b\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") "
Aug 04 00:25:21.467053 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.467011    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tztcg\" (UniqueName: \"kubernetes.io/projected/26b18342-83fa-4537-b2a1-e8a95d76a66b-kube-api-access-tztcg\") pod \"26b18342-83fa-4537-b2a1-e8a95d76a66b\" (UID: \"26b18342-83fa-4537-b2a1-e8a95d76a66b\") "
Aug 04 00:25:21.467369 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.467292    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-model-cache" (OuterVolumeSpecName: "model-cache") pod "26b18342-83fa-4537-b2a1-e8a95d76a66b" (UID: "26b18342-83fa-4537-b2a1-e8a95d76a66b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:25:21.467369 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.467307    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-home" (OuterVolumeSpecName: "home") pod "26b18342-83fa-4537-b2a1-e8a95d76a66b" (UID: "26b18342-83fa-4537-b2a1-e8a95d76a66b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:25:21.467369 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.467327    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26b18342-83fa-4537-b2a1-e8a95d76a66b" (UID: "26b18342-83fa-4537-b2a1-e8a95d76a66b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:25:21.469246 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.469220    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26b18342-83fa-4537-b2a1-e8a95d76a66b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26b18342-83fa-4537-b2a1-e8a95d76a66b" (UID: "26b18342-83fa-4537-b2a1-e8a95d76a66b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:25:21.469361 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.469303    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b18342-83fa-4537-b2a1-e8a95d76a66b-kube-api-access-tztcg" (OuterVolumeSpecName: "kube-api-access-tztcg") pod "26b18342-83fa-4537-b2a1-e8a95d76a66b" (UID: "26b18342-83fa-4537-b2a1-e8a95d76a66b"). InnerVolumeSpecName "kube-api-access-tztcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:25:21.469361 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.469303    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-dshm" (OuterVolumeSpecName: "dshm") pod "26b18342-83fa-4537-b2a1-e8a95d76a66b" (UID: "26b18342-83fa-4537-b2a1-e8a95d76a66b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:25:21.568410 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.568363    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b18342-83fa-4537-b2a1-e8a95d76a66b-tls-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:21.568410 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.568397    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-model-cache\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:21.568410 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.568406    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-dshm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:21.568410 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.568414    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-home\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:21.568410 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.568422    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26b18342-83fa-4537-b2a1-e8a95d76a66b-tmp-dir\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:21.568708 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.568430    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tztcg\" (UniqueName: \"kubernetes.io/projected/26b18342-83fa-4537-b2a1-e8a95d76a66b-kube-api-access-tztcg\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:25:21.660214 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.660178    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58fdcb9b-fde6-4e81-8a75-17625dff381e" path="/var/lib/kubelet/pods/58fdcb9b-fde6-4e81-8a75-17625dff381e/volumes"
Aug 04 00:25:21.872818 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.872781    2568 generic.go:356] "Generic (PLEG): container finished" podID="26b18342-83fa-4537-b2a1-e8a95d76a66b" containerID="c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf" exitCode=0
Aug 04 00:25:21.873024 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.872835    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"
Aug 04 00:25:21.873024 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.872864    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl" event={"ID":"26b18342-83fa-4537-b2a1-e8a95d76a66b","Type":"ContainerDied","Data":"c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf"}
Aug 04 00:25:21.873024 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.872904    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl" event={"ID":"26b18342-83fa-4537-b2a1-e8a95d76a66b","Type":"ContainerDied","Data":"3a59dd9982ff239b42c1ee8b0436e8a498d98865f9421223823597352b988b23"}
Aug 04 00:25:21.873024 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.872920    2568 scope.go:117] "RemoveContainer" containerID="c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf"
Aug 04 00:25:21.881637 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.881614    2568 scope.go:117] "RemoveContainer" containerID="c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf"
Aug 04 00:25:21.881897 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:25:21.881877    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf\": container with ID starting with c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf not found: ID does not exist" containerID="c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf"
Aug 04 00:25:21.881946 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.881906    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf"} err="failed to get container status \"c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf\": rpc error: code = NotFound desc = could not find container \"c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf\": container with ID starting with c0c91115ac08ab141a0e3d83505daedcf1ae93ac8f1d0f76272160efa0c6decf not found: ID does not exist"
Aug 04 00:25:21.889154 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.889126    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"]
Aug 04 00:25:21.894841 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:21.894816    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/sub-test-model-98f978-kserve-569d9d644f-hrvxl"]
Aug 04 00:25:23.660219 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:23.660185    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26b18342-83fa-4537-b2a1-e8a95d76a66b" path="/var/lib/kubelet/pods/26b18342-83fa-4537-b2a1-e8a95d76a66b/volumes"
Aug 04 00:25:43.852817 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.852783    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"]
Aug 04 00:25:43.853376 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.853129    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58fdcb9b-fde6-4e81-8a75-17625dff381e" containerName="main"
Aug 04 00:25:43.853376 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.853140    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58fdcb9b-fde6-4e81-8a75-17625dff381e" containerName="main"
Aug 04 00:25:43.853376 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.853151    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b18342-83fa-4537-b2a1-e8a95d76a66b" containerName="main"
Aug 04 00:25:43.853376 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.853156    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b18342-83fa-4537-b2a1-e8a95d76a66b" containerName="main"
Aug 04 00:25:43.853376 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.853208    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b18342-83fa-4537-b2a1-e8a95d76a66b" containerName="main"
Aug 04 00:25:43.853376 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.853218    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="58fdcb9b-fde6-4e81-8a75-17625dff381e" containerName="main"
Aug 04 00:25:43.855761 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.855744    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:43.858003 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.857981    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"kube-root-ca.crt\""
Aug 04 00:25:43.859022 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.859001    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"default-dockercfg-wgkhz\""
Aug 04 00:25:43.859022 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.859012    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"rate-test-model-98f978-kserve-self-signed-certs\""
Aug 04 00:25:43.859186 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.859026    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-98f978\"/\"openshift-service-ca.crt\""
Aug 04 00:25:43.865218 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.865193    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"]
Aug 04 00:25:43.943414 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.943378    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:25:43.977202 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.977159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/742695bd-be41-4099-b3e3-e4a2add9e743-tls-certs\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:43.977202 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.977208    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz7rm\" (UniqueName: \"kubernetes.io/projected/742695bd-be41-4099-b3e3-e4a2add9e743-kube-api-access-hz7rm\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:43.977486 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.977292    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-dshm\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:43.977486 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.977308    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-model-cache\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:43.977486 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.977337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-tmp-dir\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:43.977486 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:43.977360    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-home\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.077941 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.077910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/742695bd-be41-4099-b3e3-e4a2add9e743-tls-certs\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.078137 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.077948    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz7rm\" (UniqueName: \"kubernetes.io/projected/742695bd-be41-4099-b3e3-e4a2add9e743-kube-api-access-hz7rm\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.078137 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.077984    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-dshm\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.078137 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.078006    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-model-cache\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.078137 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.078046    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-tmp-dir\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.078137 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.078075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-home\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.078542 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.078519    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-model-cache\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.078653 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.078543    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-home\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.078653 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.078528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-tmp-dir\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.080392 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.080374    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-dshm\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.080653 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.080637    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/742695bd-be41-4099-b3e3-e4a2add9e743-tls-certs\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.085924 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.085906    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz7rm\" (UniqueName: \"kubernetes.io/projected/742695bd-be41-4099-b3e3-e4a2add9e743-kube-api-access-hz7rm\") pod \"rate-test-model-98f978-kserve-75f54ffbd7-qvbdz\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") " pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.165779 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.165688    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:44.300382 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.300345    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"]
Aug 04 00:25:44.305196 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:25:44.305156    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod742695bd_be41_4099_b3e3_e4a2add9e743.slice/crio-e5be1204080bd2ba945dc5a0c4c964a4f70a910b62f763813b12a6e7b856676d WatchSource:0}: Error finding container e5be1204080bd2ba945dc5a0c4c964a4f70a910b62f763813b12a6e7b856676d: Status 404 returned error can't find the container with id e5be1204080bd2ba945dc5a0c4c964a4f70a910b62f763813b12a6e7b856676d
Aug 04 00:25:44.991946 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.991896    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz" event={"ID":"742695bd-be41-4099-b3e3-e4a2add9e743","Type":"ContainerStarted","Data":"5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14"}
Aug 04 00:25:44.992465 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:44.991954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz" event={"ID":"742695bd-be41-4099-b3e3-e4a2add9e743","Type":"ContainerStarted","Data":"e5be1204080bd2ba945dc5a0c4c964a4f70a910b62f763813b12a6e7b856676d"}
Aug 04 00:25:45.009379 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:45.009320    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz" podStartSLOduration=2.009303922 podStartE2EDuration="2.009303922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:25:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:25:45.007122641 +0000 UTC m=+3345.893451108" watchObservedRunningTime="2026-08-04 00:25:45.009303922 +0000 UTC m=+3345.895632386"
Aug 04 00:25:46.449803 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:46.449766    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:25:54.166137 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:54.166091    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:54.166600 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:54.166243    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:54.179121 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:54.179098    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:25:55.051544 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:25:55.051514    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:26:23.242698 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:26:23.242659    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:26:31.350896 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:26:31.350863    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:27:02.738049 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:02.737949    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:27:08.320246 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:08.320211    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:09.148125 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:09.148083    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"]
Aug 04 00:27:09.728804 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:09.728770    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:10.108116 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:10.108029    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7212-140684077506096"]
Aug 04 00:27:10.111033 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:10.111017    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077506096"
Aug 04 00:27:10.113635 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:10.113608    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hlbbd\""
Aug 04 00:27:10.114876 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:10.114852    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077506096"]
Aug 04 00:27:10.148619 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:10.148571    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6nm4\" (UniqueName: \"kubernetes.io/projected/f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa-kube-api-access-k6nm4\") pod \"test-curl-7212-140684077506096\" (UID: \"f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa\") " pod="opendatahub/test-curl-7212-140684077506096"
Aug 04 00:27:10.249933 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:10.249896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nm4\" (UniqueName: \"kubernetes.io/projected/f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa-kube-api-access-k6nm4\") pod \"test-curl-7212-140684077506096\" (UID: \"f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa\") " pod="opendatahub/test-curl-7212-140684077506096"
Aug 04 00:27:10.258551 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:10.258516    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nm4\" (UniqueName: \"kubernetes.io/projected/f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa-kube-api-access-k6nm4\") pod \"test-curl-7212-140684077506096\" (UID: \"f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa\") " pod="opendatahub/test-curl-7212-140684077506096"
Aug 04 00:27:10.422233 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:10.422131    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077506096"
Aug 04 00:27:10.553079 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:10.553033    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077506096"]
Aug 04 00:27:10.555839 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:27:10.555809    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8e6f6b9_224f_4c6e_9fc3_2d48692e35aa.slice/crio-1ed0178babe4d6ae5d90008cb0bd4305a716d513afeda0ab403335e6d39d1b3b WatchSource:0}: Error finding container 1ed0178babe4d6ae5d90008cb0bd4305a716d513afeda0ab403335e6d39d1b3b: Status 404 returned error can't find the container with id 1ed0178babe4d6ae5d90008cb0bd4305a716d513afeda0ab403335e6d39d1b3b
Aug 04 00:27:10.557038 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:10.557021    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:27:11.430797 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:11.430760    2568 generic.go:356] "Generic (PLEG): container finished" podID="f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa" containerID="0a9f558fa03cb7498719bbf755819e889355c999c2fd4cc8d8c1280356f44c41" exitCode=0
Aug 04 00:27:11.431154 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:11.430840    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077506096" event={"ID":"f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa","Type":"ContainerDied","Data":"0a9f558fa03cb7498719bbf755819e889355c999c2fd4cc8d8c1280356f44c41"}
Aug 04 00:27:11.431154 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:11.430880    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077506096" event={"ID":"f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa","Type":"ContainerStarted","Data":"1ed0178babe4d6ae5d90008cb0bd4305a716d513afeda0ab403335e6d39d1b3b"}
Aug 04 00:27:11.843127 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:11.843092    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:27:12.567671 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.567647    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077506096"
Aug 04 00:27:12.584353 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.584324    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7212-140684077506096_f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa/test-curl-7212-140684077506096/0.log"
Aug 04 00:27:12.603728 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.603695    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7212-140684077506096"]
Aug 04 00:27:12.607946 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.607914    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7212-140684077506096"]
Aug 04 00:27:12.674017 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.673975    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6nm4\" (UniqueName: \"kubernetes.io/projected/f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa-kube-api-access-k6nm4\") pod \"f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa\" (UID: \"f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa\") "
Aug 04 00:27:12.676298 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.676240    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa-kube-api-access-k6nm4" (OuterVolumeSpecName: "kube-api-access-k6nm4") pod "f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa" (UID: "f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa"). InnerVolumeSpecName "kube-api-access-k6nm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:27:12.723720 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.723687    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7212-140684077548592"]
Aug 04 00:27:12.724083 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.724069    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa" containerName="test-curl-7212-140684077506096"
Aug 04 00:27:12.724142 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.724086    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa" containerName="test-curl-7212-140684077506096"
Aug 04 00:27:12.724174 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.724146    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa" containerName="test-curl-7212-140684077506096"
Aug 04 00:27:12.727023 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.727004    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077548592"
Aug 04 00:27:12.730002 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.729975    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077548592"]
Aug 04 00:27:12.774844 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.774815    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmchj\" (UniqueName: \"kubernetes.io/projected/c6d0132a-8388-4d91-80e2-faa6e7dbdfef-kube-api-access-cmchj\") pod \"test-curl-7212-140684077548592\" (UID: \"c6d0132a-8388-4d91-80e2-faa6e7dbdfef\") " pod="opendatahub/test-curl-7212-140684077548592"
Aug 04 00:27:12.775047 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.774909    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6nm4\" (UniqueName: \"kubernetes.io/projected/f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa-kube-api-access-k6nm4\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:12.875662 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.875618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmchj\" (UniqueName: \"kubernetes.io/projected/c6d0132a-8388-4d91-80e2-faa6e7dbdfef-kube-api-access-cmchj\") pod \"test-curl-7212-140684077548592\" (UID: \"c6d0132a-8388-4d91-80e2-faa6e7dbdfef\") " pod="opendatahub/test-curl-7212-140684077548592"
Aug 04 00:27:12.883686 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:12.883658    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmchj\" (UniqueName: \"kubernetes.io/projected/c6d0132a-8388-4d91-80e2-faa6e7dbdfef-kube-api-access-cmchj\") pod \"test-curl-7212-140684077548592\" (UID: \"c6d0132a-8388-4d91-80e2-faa6e7dbdfef\") " pod="opendatahub/test-curl-7212-140684077548592"
Aug 04 00:27:13.037930 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:13.037840    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077548592"
Aug 04 00:27:13.174371 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:13.174339    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077548592"]
Aug 04 00:27:13.176749 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:27:13.176721    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6d0132a_8388_4d91_80e2_faa6e7dbdfef.slice/crio-6507aa1c3a9bbf1f76b29e4c815f68e3198746c38dd02f5603cb8484ce6f45ce WatchSource:0}: Error finding container 6507aa1c3a9bbf1f76b29e4c815f68e3198746c38dd02f5603cb8484ce6f45ce: Status 404 returned error can't find the container with id 6507aa1c3a9bbf1f76b29e4c815f68e3198746c38dd02f5603cb8484ce6f45ce
Aug 04 00:27:13.442175 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:13.442099    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077506096"
Aug 04 00:27:13.442175 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:13.442124    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ed0178babe4d6ae5d90008cb0bd4305a716d513afeda0ab403335e6d39d1b3b"
Aug 04 00:27:13.443318 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:13.443282    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077548592" event={"ID":"c6d0132a-8388-4d91-80e2-faa6e7dbdfef","Type":"ContainerStarted","Data":"6507aa1c3a9bbf1f76b29e4c815f68e3198746c38dd02f5603cb8484ce6f45ce"}
Aug 04 00:27:13.452132 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:27:13.452109    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7212-140684077506096\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa" pod="opendatahub/test-curl-7212-140684077506096"
Aug 04 00:27:13.662228 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:13.662196    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa" path="/var/lib/kubelet/pods/f8e6f6b9-224f-4c6e-9fc3-2d48692e35aa/volumes"
Aug 04 00:27:14.449955 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:14.449922    2568 generic.go:356] "Generic (PLEG): container finished" podID="c6d0132a-8388-4d91-80e2-faa6e7dbdfef" containerID="757acbe626f308cc9f2e1fbe086dfa80f19ce7e45b00214ef982ab06ddcc2779" exitCode=0
Aug 04 00:27:14.450141 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:14.450023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077548592" event={"ID":"c6d0132a-8388-4d91-80e2-faa6e7dbdfef","Type":"ContainerDied","Data":"757acbe626f308cc9f2e1fbe086dfa80f19ce7e45b00214ef982ab06ddcc2779"}
Aug 04 00:27:15.598207 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.598182    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077548592"
Aug 04 00:27:15.616219 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.616194    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7212-140684077548592_c6d0132a-8388-4d91-80e2-faa6e7dbdfef/test-curl-7212-140684077548592/0.log"
Aug 04 00:27:15.637872 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.637842    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7212-140684077548592"]
Aug 04 00:27:15.642660 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.642633    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7212-140684077548592"]
Aug 04 00:27:15.704388 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.704359    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmchj\" (UniqueName: \"kubernetes.io/projected/c6d0132a-8388-4d91-80e2-faa6e7dbdfef-kube-api-access-cmchj\") pod \"c6d0132a-8388-4d91-80e2-faa6e7dbdfef\" (UID: \"c6d0132a-8388-4d91-80e2-faa6e7dbdfef\") "
Aug 04 00:27:15.706590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.706516    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6d0132a-8388-4d91-80e2-faa6e7dbdfef-kube-api-access-cmchj" (OuterVolumeSpecName: "kube-api-access-cmchj") pod "c6d0132a-8388-4d91-80e2-faa6e7dbdfef" (UID: "c6d0132a-8388-4d91-80e2-faa6e7dbdfef"). InnerVolumeSpecName "kube-api-access-cmchj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:27:15.790124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.790087    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7212-140684077481248"]
Aug 04 00:27:15.790505 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.790490    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d0132a-8388-4d91-80e2-faa6e7dbdfef" containerName="test-curl-7212-140684077548592"
Aug 04 00:27:15.790553 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.790508    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d0132a-8388-4d91-80e2-faa6e7dbdfef" containerName="test-curl-7212-140684077548592"
Aug 04 00:27:15.790588 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.790568    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6d0132a-8388-4d91-80e2-faa6e7dbdfef" containerName="test-curl-7212-140684077548592"
Aug 04 00:27:15.793363 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.793346    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:15.798623 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.798593    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077481248"]
Aug 04 00:27:15.805761 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.805735    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmchj\" (UniqueName: \"kubernetes.io/projected/c6d0132a-8388-4d91-80e2-faa6e7dbdfef-kube-api-access-cmchj\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:15.906321 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:15.906287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5288w\" (UniqueName: \"kubernetes.io/projected/07264b21-faab-427e-9163-3a84e1ad2913-kube-api-access-5288w\") pod \"test-curl-7212-140684077481248\" (UID: \"07264b21-faab-427e-9163-3a84e1ad2913\") " pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:16.007706 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:16.007670    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5288w\" (UniqueName: \"kubernetes.io/projected/07264b21-faab-427e-9163-3a84e1ad2913-kube-api-access-5288w\") pod \"test-curl-7212-140684077481248\" (UID: \"07264b21-faab-427e-9163-3a84e1ad2913\") " pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:16.015852 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:16.015817    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5288w\" (UniqueName: \"kubernetes.io/projected/07264b21-faab-427e-9163-3a84e1ad2913-kube-api-access-5288w\") pod \"test-curl-7212-140684077481248\" (UID: \"07264b21-faab-427e-9163-3a84e1ad2913\") " pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:16.104888 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:16.104851    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:16.234684 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:16.234660    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077481248"]
Aug 04 00:27:16.237225 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:27:16.237195    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07264b21_faab_427e_9163_3a84e1ad2913.slice/crio-eb420e2ed38e795bbd8c12160987c16560c326ecdfba273bc40c7628349ced10 WatchSource:0}: Error finding container eb420e2ed38e795bbd8c12160987c16560c326ecdfba273bc40c7628349ced10: Status 404 returned error can't find the container with id eb420e2ed38e795bbd8c12160987c16560c326ecdfba273bc40c7628349ced10
Aug 04 00:27:16.460652 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:16.460616    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077548592"
Aug 04 00:27:16.460823 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:16.460625    2568 scope.go:117] "RemoveContainer" containerID="757acbe626f308cc9f2e1fbe086dfa80f19ce7e45b00214ef982ab06ddcc2779"
Aug 04 00:27:16.462006 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:16.461982    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077481248" event={"ID":"07264b21-faab-427e-9163-3a84e1ad2913","Type":"ContainerStarted","Data":"eb420e2ed38e795bbd8c12160987c16560c326ecdfba273bc40c7628349ced10"}
Aug 04 00:27:17.468762 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:17.468726    2568 generic.go:356] "Generic (PLEG): container finished" podID="07264b21-faab-427e-9163-3a84e1ad2913" containerID="fe59e090bbfcca3c705b345bc5b1a46bdb78b530fbfaf02709d9542ef0bff27e" exitCode=0
Aug 04 00:27:17.469163 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:17.468806    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077481248" event={"ID":"07264b21-faab-427e-9163-3a84e1ad2913","Type":"ContainerDied","Data":"fe59e090bbfcca3c705b345bc5b1a46bdb78b530fbfaf02709d9542ef0bff27e"}
Aug 04 00:27:17.660766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:17.660731    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6d0132a-8388-4d91-80e2-faa6e7dbdfef" path="/var/lib/kubelet/pods/c6d0132a-8388-4d91-80e2-faa6e7dbdfef/volumes"
Aug 04 00:27:18.602714 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.602689    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:18.620108 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.620085    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7212-140684077481248_07264b21-faab-427e-9163-3a84e1ad2913/test-curl-7212-140684077481248/0.log"
Aug 04 00:27:18.641069 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.641035    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7212-140684077481248"]
Aug 04 00:27:18.644698 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.644672    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7212-140684077481248"]
Aug 04 00:27:18.734636 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.734543    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5288w\" (UniqueName: \"kubernetes.io/projected/07264b21-faab-427e-9163-3a84e1ad2913-kube-api-access-5288w\") pod \"07264b21-faab-427e-9163-3a84e1ad2913\" (UID: \"07264b21-faab-427e-9163-3a84e1ad2913\") "
Aug 04 00:27:18.736868 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.736842    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07264b21-faab-427e-9163-3a84e1ad2913-kube-api-access-5288w" (OuterVolumeSpecName: "kube-api-access-5288w") pod "07264b21-faab-427e-9163-3a84e1ad2913" (UID: "07264b21-faab-427e-9163-3a84e1ad2913"). InnerVolumeSpecName "kube-api-access-5288w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:27:18.756528 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.756500    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7212-140684077481248"]
Aug 04 00:27:18.756853 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.756839    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07264b21-faab-427e-9163-3a84e1ad2913" containerName="test-curl-7212-140684077481248"
Aug 04 00:27:18.756908 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.756855    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="07264b21-faab-427e-9163-3a84e1ad2913" containerName="test-curl-7212-140684077481248"
Aug 04 00:27:18.756944 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.756922    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="07264b21-faab-427e-9163-3a84e1ad2913" containerName="test-curl-7212-140684077481248"
Aug 04 00:27:18.759711 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.759696    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:18.763335 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.763315    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077481248"]
Aug 04 00:27:18.835307 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.835250    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsjpb\" (UniqueName: \"kubernetes.io/projected/5d9b6fb9-69ec-4765-9d42-5444d1e2caa4-kube-api-access-hsjpb\") pod \"test-curl-7212-140684077481248\" (UID: \"5d9b6fb9-69ec-4765-9d42-5444d1e2caa4\") " pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:18.835474 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.835418    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5288w\" (UniqueName: \"kubernetes.io/projected/07264b21-faab-427e-9163-3a84e1ad2913-kube-api-access-5288w\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:18.936626 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.936586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsjpb\" (UniqueName: \"kubernetes.io/projected/5d9b6fb9-69ec-4765-9d42-5444d1e2caa4-kube-api-access-hsjpb\") pod \"test-curl-7212-140684077481248\" (UID: \"5d9b6fb9-69ec-4765-9d42-5444d1e2caa4\") " pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:18.945591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:18.945559    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsjpb\" (UniqueName: \"kubernetes.io/projected/5d9b6fb9-69ec-4765-9d42-5444d1e2caa4-kube-api-access-hsjpb\") pod \"test-curl-7212-140684077481248\" (UID: \"5d9b6fb9-69ec-4765-9d42-5444d1e2caa4\") " pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:19.070368 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:19.070274    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:19.203314 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:19.203284    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077481248"]
Aug 04 00:27:19.205456 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:27:19.205427    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d9b6fb9_69ec_4765_9d42_5444d1e2caa4.slice/crio-3485e2787492f2f797fa783c911d674fd3a4ee7bc9445193afccfc59eb1169ed WatchSource:0}: Error finding container 3485e2787492f2f797fa783c911d674fd3a4ee7bc9445193afccfc59eb1169ed: Status 404 returned error can't find the container with id 3485e2787492f2f797fa783c911d674fd3a4ee7bc9445193afccfc59eb1169ed
Aug 04 00:27:19.479777 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:19.479741    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:19.479969 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:19.479747    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb420e2ed38e795bbd8c12160987c16560c326ecdfba273bc40c7628349ced10"
Aug 04 00:27:19.480956 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:19.480933    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077481248" event={"ID":"5d9b6fb9-69ec-4765-9d42-5444d1e2caa4","Type":"ContainerStarted","Data":"3485e2787492f2f797fa783c911d674fd3a4ee7bc9445193afccfc59eb1169ed"}
Aug 04 00:27:19.491133 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:19.491085    2568 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7212-140684077481248" oldPodUID="07264b21-faab-427e-9163-3a84e1ad2913" podUID="5d9b6fb9-69ec-4765-9d42-5444d1e2caa4"
Aug 04 00:27:19.660599 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:19.660561    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07264b21-faab-427e-9163-3a84e1ad2913" path="/var/lib/kubelet/pods/07264b21-faab-427e-9163-3a84e1ad2913/volumes"
Aug 04 00:27:20.492803 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:20.492767    2568 generic.go:356] "Generic (PLEG): container finished" podID="5d9b6fb9-69ec-4765-9d42-5444d1e2caa4" containerID="a9700ff4093564df5fae8a26a4b7082f9284fa76d1784aa5850b02540fcb1add" exitCode=0
Aug 04 00:27:20.492958 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:20.492844    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077481248" event={"ID":"5d9b6fb9-69ec-4765-9d42-5444d1e2caa4","Type":"ContainerDied","Data":"a9700ff4093564df5fae8a26a4b7082f9284fa76d1784aa5850b02540fcb1add"}
Aug 04 00:27:21.632712 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.632686    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:21.650976 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.650939    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7212-140684077481248_5d9b6fb9-69ec-4765-9d42-5444d1e2caa4/test-curl-7212-140684077481248/0.log"
Aug 04 00:27:21.674171 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.674142    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7212-140684077481248"]
Aug 04 00:27:21.677419 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.677398    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7212-140684077481248"]
Aug 04 00:27:21.765193 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.765112    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsjpb\" (UniqueName: \"kubernetes.io/projected/5d9b6fb9-69ec-4765-9d42-5444d1e2caa4-kube-api-access-hsjpb\") pod \"5d9b6fb9-69ec-4765-9d42-5444d1e2caa4\" (UID: \"5d9b6fb9-69ec-4765-9d42-5444d1e2caa4\") "
Aug 04 00:27:21.767426 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.767394    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d9b6fb9-69ec-4765-9d42-5444d1e2caa4-kube-api-access-hsjpb" (OuterVolumeSpecName: "kube-api-access-hsjpb") pod "5d9b6fb9-69ec-4765-9d42-5444d1e2caa4" (UID: "5d9b6fb9-69ec-4765-9d42-5444d1e2caa4"). InnerVolumeSpecName "kube-api-access-hsjpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:27:21.789334 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.789302    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7212-140684077560144"]
Aug 04 00:27:21.789650 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.789638    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9b6fb9-69ec-4765-9d42-5444d1e2caa4" containerName="test-curl-7212-140684077481248"
Aug 04 00:27:21.789688 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.789652    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9b6fb9-69ec-4765-9d42-5444d1e2caa4" containerName="test-curl-7212-140684077481248"
Aug 04 00:27:21.789734 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.789724    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d9b6fb9-69ec-4765-9d42-5444d1e2caa4" containerName="test-curl-7212-140684077481248"
Aug 04 00:27:21.792624 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.792596    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:21.797236 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.797215    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077560144"]
Aug 04 00:27:21.866437 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.866403    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c7nb\" (UniqueName: \"kubernetes.io/projected/10e51b4b-905b-4b48-acc7-0b1a99c129ab-kube-api-access-2c7nb\") pod \"test-curl-7212-140684077560144\" (UID: \"10e51b4b-905b-4b48-acc7-0b1a99c129ab\") " pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:21.866589 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.866455    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsjpb\" (UniqueName: \"kubernetes.io/projected/5d9b6fb9-69ec-4765-9d42-5444d1e2caa4-kube-api-access-hsjpb\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:21.967082 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.967043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c7nb\" (UniqueName: \"kubernetes.io/projected/10e51b4b-905b-4b48-acc7-0b1a99c129ab-kube-api-access-2c7nb\") pod \"test-curl-7212-140684077560144\" (UID: \"10e51b4b-905b-4b48-acc7-0b1a99c129ab\") " pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:21.975123 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:21.975087    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c7nb\" (UniqueName: \"kubernetes.io/projected/10e51b4b-905b-4b48-acc7-0b1a99c129ab-kube-api-access-2c7nb\") pod \"test-curl-7212-140684077560144\" (UID: \"10e51b4b-905b-4b48-acc7-0b1a99c129ab\") " pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:22.104045 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:22.103954    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:22.238440 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:22.238418    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077560144"]
Aug 04 00:27:22.240488 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:27:22.240459    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10e51b4b_905b_4b48_acc7_0b1a99c129ab.slice/crio-9d8414f444cdfbb82a9c4a33626b340121672a22633d7a892526f11dd53e4259 WatchSource:0}: Error finding container 9d8414f444cdfbb82a9c4a33626b340121672a22633d7a892526f11dd53e4259: Status 404 returned error can't find the container with id 9d8414f444cdfbb82a9c4a33626b340121672a22633d7a892526f11dd53e4259
Aug 04 00:27:22.503456 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:22.503423    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:22.503671 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:22.503497    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3485e2787492f2f797fa783c911d674fd3a4ee7bc9445193afccfc59eb1169ed"
Aug 04 00:27:22.504784 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:22.504758    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077560144" event={"ID":"10e51b4b-905b-4b48-acc7-0b1a99c129ab","Type":"ContainerStarted","Data":"9d8414f444cdfbb82a9c4a33626b340121672a22633d7a892526f11dd53e4259"}
Aug 04 00:27:22.513804 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:27:22.513773    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7212-140684077481248\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="5d9b6fb9-69ec-4765-9d42-5444d1e2caa4" pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:23.511783 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:23.511744    2568 generic.go:356] "Generic (PLEG): container finished" podID="10e51b4b-905b-4b48-acc7-0b1a99c129ab" containerID="3dca71e03aff5c020962636ffba1c386f05f8f8737e90eb1d5e238fd9d6a1f27" exitCode=0
Aug 04 00:27:23.512156 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:23.511834    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077560144" event={"ID":"10e51b4b-905b-4b48-acc7-0b1a99c129ab","Type":"ContainerDied","Data":"3dca71e03aff5c020962636ffba1c386f05f8f8737e90eb1d5e238fd9d6a1f27"}
Aug 04 00:27:23.526102 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:27:23.526076    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7212-140684077481248\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="5d9b6fb9-69ec-4765-9d42-5444d1e2caa4" pod="opendatahub/test-curl-7212-140684077481248"
Aug 04 00:27:23.659519 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:23.659486    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d9b6fb9-69ec-4765-9d42-5444d1e2caa4" path="/var/lib/kubelet/pods/5d9b6fb9-69ec-4765-9d42-5444d1e2caa4/volumes"
Aug 04 00:27:24.167350 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.167303    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz" podUID="742695bd-be41-4099-b3e3-e4a2add9e743" containerName="main" containerID="cri-o://5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14" gracePeriod=45
Aug 04 00:27:24.427151 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.427088    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:27:24.517725 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.517693    2568 generic.go:356] "Generic (PLEG): container finished" podID="742695bd-be41-4099-b3e3-e4a2add9e743" containerID="5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14" exitCode=0
Aug 04 00:27:24.518131 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.517741    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"
Aug 04 00:27:24.518131 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.517777    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz" event={"ID":"742695bd-be41-4099-b3e3-e4a2add9e743","Type":"ContainerDied","Data":"5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14"}
Aug 04 00:27:24.518131 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.517821    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz" event={"ID":"742695bd-be41-4099-b3e3-e4a2add9e743","Type":"ContainerDied","Data":"e5be1204080bd2ba945dc5a0c4c964a4f70a910b62f763813b12a6e7b856676d"}
Aug 04 00:27:24.518131 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.517843    2568 scope.go:117] "RemoveContainer" containerID="5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14"
Aug 04 00:27:24.526641 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.526600    2568 scope.go:117] "RemoveContainer" containerID="5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14"
Aug 04 00:27:24.526937 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:27:24.526913    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14\": container with ID starting with 5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14 not found: ID does not exist" containerID="5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14"
Aug 04 00:27:24.526989 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.526948    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14"} err="failed to get container status \"5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14\": rpc error: code = NotFound desc = could not find container \"5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14\": container with ID starting with 5a9fc36fb78b4dce3ecbc1fd6b6a476a6a4fc0f1942e429b0be0ee9a307e8e14 not found: ID does not exist"
Aug 04 00:27:24.590720 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.590690    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-tmp-dir\") pod \"742695bd-be41-4099-b3e3-e4a2add9e743\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") "
Aug 04 00:27:24.590899 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.590761    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/742695bd-be41-4099-b3e3-e4a2add9e743-tls-certs\") pod \"742695bd-be41-4099-b3e3-e4a2add9e743\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") "
Aug 04 00:27:24.590899 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.590786    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-home\") pod \"742695bd-be41-4099-b3e3-e4a2add9e743\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") "
Aug 04 00:27:24.590899 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.590810    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-model-cache\") pod \"742695bd-be41-4099-b3e3-e4a2add9e743\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") "
Aug 04 00:27:24.590899 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.590837    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-dshm\") pod \"742695bd-be41-4099-b3e3-e4a2add9e743\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") "
Aug 04 00:27:24.591113 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.590919    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz7rm\" (UniqueName: \"kubernetes.io/projected/742695bd-be41-4099-b3e3-e4a2add9e743-kube-api-access-hz7rm\") pod \"742695bd-be41-4099-b3e3-e4a2add9e743\" (UID: \"742695bd-be41-4099-b3e3-e4a2add9e743\") "
Aug 04 00:27:24.591113 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.591001    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "742695bd-be41-4099-b3e3-e4a2add9e743" (UID: "742695bd-be41-4099-b3e3-e4a2add9e743"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:24.591207 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.591158    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-tmp-dir\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:24.591250 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.591236    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-home" (OuterVolumeSpecName: "home") pod "742695bd-be41-4099-b3e3-e4a2add9e743" (UID: "742695bd-be41-4099-b3e3-e4a2add9e743"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:24.591339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.591321    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-model-cache" (OuterVolumeSpecName: "model-cache") pod "742695bd-be41-4099-b3e3-e4a2add9e743" (UID: "742695bd-be41-4099-b3e3-e4a2add9e743"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:24.593726 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.593693    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-dshm" (OuterVolumeSpecName: "dshm") pod "742695bd-be41-4099-b3e3-e4a2add9e743" (UID: "742695bd-be41-4099-b3e3-e4a2add9e743"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:24.593726 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.593716    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/742695bd-be41-4099-b3e3-e4a2add9e743-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "742695bd-be41-4099-b3e3-e4a2add9e743" (UID: "742695bd-be41-4099-b3e3-e4a2add9e743"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:27:24.593890 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.593786    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/742695bd-be41-4099-b3e3-e4a2add9e743-kube-api-access-hz7rm" (OuterVolumeSpecName: "kube-api-access-hz7rm") pod "742695bd-be41-4099-b3e3-e4a2add9e743" (UID: "742695bd-be41-4099-b3e3-e4a2add9e743"). InnerVolumeSpecName "kube-api-access-hz7rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:27:24.647866 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.647843    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:24.665449 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.665406    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7212-140684077560144_10e51b4b-905b-4b48-acc7-0b1a99c129ab/test-curl-7212-140684077560144/0.log"
Aug 04 00:27:24.685080 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.684973    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7212-140684077560144"]
Aug 04 00:27:24.688181 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.688148    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7212-140684077560144"]
Aug 04 00:27:24.691696 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.691670    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz7rm\" (UniqueName: \"kubernetes.io/projected/742695bd-be41-4099-b3e3-e4a2add9e743-kube-api-access-hz7rm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:24.691696 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.691692    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/742695bd-be41-4099-b3e3-e4a2add9e743-tls-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:24.691877 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.691704    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-home\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:24.691877 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.691712    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-model-cache\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:24.691877 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.691719    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/742695bd-be41-4099-b3e3-e4a2add9e743-dshm\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:24.792385 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.792351    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c7nb\" (UniqueName: \"kubernetes.io/projected/10e51b4b-905b-4b48-acc7-0b1a99c129ab-kube-api-access-2c7nb\") pod \"10e51b4b-905b-4b48-acc7-0b1a99c129ab\" (UID: \"10e51b4b-905b-4b48-acc7-0b1a99c129ab\") "
Aug 04 00:27:24.794628 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.794601    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10e51b4b-905b-4b48-acc7-0b1a99c129ab-kube-api-access-2c7nb" (OuterVolumeSpecName: "kube-api-access-2c7nb") pod "10e51b4b-905b-4b48-acc7-0b1a99c129ab" (UID: "10e51b4b-905b-4b48-acc7-0b1a99c129ab"). InnerVolumeSpecName "kube-api-access-2c7nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:27:24.800760 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.800737    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7212-140684077560144"]
Aug 04 00:27:24.801060 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.801048    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="742695bd-be41-4099-b3e3-e4a2add9e743" containerName="main"
Aug 04 00:27:24.801099 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.801062    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="742695bd-be41-4099-b3e3-e4a2add9e743" containerName="main"
Aug 04 00:27:24.801099 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.801071    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10e51b4b-905b-4b48-acc7-0b1a99c129ab" containerName="test-curl-7212-140684077560144"
Aug 04 00:27:24.801099 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.801077    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="10e51b4b-905b-4b48-acc7-0b1a99c129ab" containerName="test-curl-7212-140684077560144"
Aug 04 00:27:24.801222 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.801142    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="10e51b4b-905b-4b48-acc7-0b1a99c129ab" containerName="test-curl-7212-140684077560144"
Aug 04 00:27:24.801222 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.801150    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="742695bd-be41-4099-b3e3-e4a2add9e743" containerName="main"
Aug 04 00:27:24.804144 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.804129    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:24.808975 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.808951    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077560144"]
Aug 04 00:27:24.837495 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.837459    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"]
Aug 04 00:27:24.839151 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.839124    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-98f978/rate-test-model-98f978-kserve-75f54ffbd7-qvbdz"]
Aug 04 00:27:24.893864 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.893821    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gmhv\" (UniqueName: \"kubernetes.io/projected/d42c3caa-b4b4-4136-a488-7025319a2a37-kube-api-access-5gmhv\") pod \"test-curl-7212-140684077560144\" (UID: \"d42c3caa-b4b4-4136-a488-7025319a2a37\") " pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:24.899674 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.894353    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c7nb\" (UniqueName: \"kubernetes.io/projected/10e51b4b-905b-4b48-acc7-0b1a99c129ab-kube-api-access-2c7nb\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:24.994970 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:24.994924    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gmhv\" (UniqueName: \"kubernetes.io/projected/d42c3caa-b4b4-4136-a488-7025319a2a37-kube-api-access-5gmhv\") pod \"test-curl-7212-140684077560144\" (UID: \"d42c3caa-b4b4-4136-a488-7025319a2a37\") " pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:25.003229 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:25.003200    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gmhv\" (UniqueName: \"kubernetes.io/projected/d42c3caa-b4b4-4136-a488-7025319a2a37-kube-api-access-5gmhv\") pod \"test-curl-7212-140684077560144\" (UID: \"d42c3caa-b4b4-4136-a488-7025319a2a37\") " pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:25.116049 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:25.116012    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:25.251177 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:25.250833    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7212-140684077560144"]
Aug 04 00:27:25.253339 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:27:25.253311    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd42c3caa_b4b4_4136_a488_7025319a2a37.slice/crio-86c89b03da27b2dbbad770de3e98887b913442b6bfbee4ad0ccc3744ccecc5f8 WatchSource:0}: Error finding container 86c89b03da27b2dbbad770de3e98887b913442b6bfbee4ad0ccc3744ccecc5f8: Status 404 returned error can't find the container with id 86c89b03da27b2dbbad770de3e98887b913442b6bfbee4ad0ccc3744ccecc5f8
Aug 04 00:27:25.524280 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:25.524237    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:25.524695 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:25.524292    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d8414f444cdfbb82a9c4a33626b340121672a22633d7a892526f11dd53e4259"
Aug 04 00:27:25.525490 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:25.525468    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077560144" event={"ID":"d42c3caa-b4b4-4136-a488-7025319a2a37","Type":"ContainerStarted","Data":"86c89b03da27b2dbbad770de3e98887b913442b6bfbee4ad0ccc3744ccecc5f8"}
Aug 04 00:27:25.535956 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:25.535928    2568 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7212-140684077560144" oldPodUID="10e51b4b-905b-4b48-acc7-0b1a99c129ab" podUID="d42c3caa-b4b4-4136-a488-7025319a2a37"
Aug 04 00:27:25.662701 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:25.662666    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10e51b4b-905b-4b48-acc7-0b1a99c129ab" path="/var/lib/kubelet/pods/10e51b4b-905b-4b48-acc7-0b1a99c129ab/volumes"
Aug 04 00:27:25.663104 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:25.663088    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="742695bd-be41-4099-b3e3-e4a2add9e743" path="/var/lib/kubelet/pods/742695bd-be41-4099-b3e3-e4a2add9e743/volumes"
Aug 04 00:27:26.532790 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:26.532755    2568 generic.go:356] "Generic (PLEG): container finished" podID="d42c3caa-b4b4-4136-a488-7025319a2a37" containerID="a031923f807eaa739774ecaaecb8516c7c5a85d9639103f1078cf6e2d31936cf" exitCode=0
Aug 04 00:27:26.533181 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:26.532839    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7212-140684077560144" event={"ID":"d42c3caa-b4b4-4136-a488-7025319a2a37","Type":"ContainerDied","Data":"a031923f807eaa739774ecaaecb8516c7c5a85d9639103f1078cf6e2d31936cf"}
Aug 04 00:27:27.678677 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:27.678653    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:27.697605 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:27.697573    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7212-140684077560144_d42c3caa-b4b4-4136-a488-7025319a2a37/test-curl-7212-140684077560144/0.log"
Aug 04 00:27:27.719420 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:27.719385    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7212-140684077560144"]
Aug 04 00:27:27.721009 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:27.720981    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7212-140684077560144"]
Aug 04 00:27:27.823211 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:27.823126    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gmhv\" (UniqueName: \"kubernetes.io/projected/d42c3caa-b4b4-4136-a488-7025319a2a37-kube-api-access-5gmhv\") pod \"d42c3caa-b4b4-4136-a488-7025319a2a37\" (UID: \"d42c3caa-b4b4-4136-a488-7025319a2a37\") "
Aug 04 00:27:27.825229 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:27.825200    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42c3caa-b4b4-4136-a488-7025319a2a37-kube-api-access-5gmhv" (OuterVolumeSpecName: "kube-api-access-5gmhv") pod "d42c3caa-b4b4-4136-a488-7025319a2a37" (UID: "d42c3caa-b4b4-4136-a488-7025319a2a37"). InnerVolumeSpecName "kube-api-access-5gmhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:27:27.924940 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:27.924899    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gmhv\" (UniqueName: \"kubernetes.io/projected/d42c3caa-b4b4-4136-a488-7025319a2a37-kube-api-access-5gmhv\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:27:28.218112 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.218032    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:28.476690 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.476649    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"]
Aug 04 00:27:28.477187 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.477169    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42c3caa-b4b4-4136-a488-7025319a2a37" containerName="test-curl-7212-140684077560144"
Aug 04 00:27:28.477248 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.477191    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42c3caa-b4b4-4136-a488-7025319a2a37" containerName="test-curl-7212-140684077560144"
Aug 04 00:27:28.477325 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.477293    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42c3caa-b4b4-4136-a488-7025319a2a37" containerName="test-curl-7212-140684077560144"
Aug 04 00:27:28.480530 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.480508    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.482664 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.482645    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-8c194a-openshift-default-dockercfg-h5dth\""
Aug 04 00:27:28.489350 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.489324    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"]
Aug 04 00:27:28.504505 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.504464    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:28.543215 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.543189    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86c89b03da27b2dbbad770de3e98887b913442b6bfbee4ad0ccc3744ccecc5f8"
Aug 04 00:27:28.543215 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.543190    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:28.553136 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:27:28.553099    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7212-140684077560144\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="d42c3caa-b4b4-4136-a488-7025319a2a37" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:28.632387 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.632346    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-socket\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.632387 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.632389    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-data\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.632622 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.632489    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-credential-socket\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.632622 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.632506    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-token\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.632622 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.632524    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-podinfo\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.632622 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.632547    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x4cl\" (UniqueName: \"kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-kube-api-access-8x4cl\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.632813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.632633    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-certs\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.632813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.632686    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-envoy\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.632813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.632713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istiod-ca-cert\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.733439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733345    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-credential-socket\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.733439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733381    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-token\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.733439 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733419    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-podinfo\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x4cl\" (UniqueName: \"kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-kube-api-access-8x4cl\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-certs\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-envoy\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istiod-ca-cert\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733602    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-socket\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-data\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-credential-socket\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734042 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.733967    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-data\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734351 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.734071    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-socket\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734351 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.734140    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-certs\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.734413 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.734347    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istiod-ca-cert\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.735872 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.735853    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-envoy\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.736223 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.736198    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-podinfo\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.741750 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.741725    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-token\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.741853 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.741746    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x4cl\" (UniqueName: \"kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-kube-api-access-8x4cl\") pod \"e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") " pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.793008 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.792974    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:28.939610 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.939522    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"]
Aug 04 00:27:28.941881 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:27:28.941852    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a5cc10_dd83_46d4_b3c7_0b512e1ffff6.slice/crio-194e910a0ee18d06341398779a7bdca3c75ae5a1e2ef58f8a29fa6aa4708f9e5 WatchSource:0}: Error finding container 194e910a0ee18d06341398779a7bdca3c75ae5a1e2ef58f8a29fa6aa4708f9e5: Status 404 returned error can't find the container with id 194e910a0ee18d06341398779a7bdca3c75ae5a1e2ef58f8a29fa6aa4708f9e5
Aug 04 00:27:28.944226 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.944194    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:27:28.944338 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.944276    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:27:28.944338 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:28.944315    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:27:29.152231 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:29.152198    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:29.550435 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:29.550394    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" event={"ID":"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6","Type":"ContainerStarted","Data":"c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af"}
Aug 04 00:27:29.550618 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:29.550504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" event={"ID":"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6","Type":"ContainerStarted","Data":"194e910a0ee18d06341398779a7bdca3c75ae5a1e2ef58f8a29fa6aa4708f9e5"}
Aug 04 00:27:29.571462 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:29.571414    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" podStartSLOduration=1.571399534 podStartE2EDuration="1.571399534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:27:29.570067403 +0000 UTC m=+3450.456395867" watchObservedRunningTime="2026-08-04 00:27:29.571399534 +0000 UTC m=+3450.457727998"
Aug 04 00:27:29.571738 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:27:29.571712    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7212-140684077560144\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="d42c3caa-b4b4-4136-a488-7025319a2a37" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:29.658541 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:27:29.658505    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7212-140684077560144\" is forbidden: User \"system:node:ip-10-0-138-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-58.ec2.internal' and this object" podUID="d42c3caa-b4b4-4136-a488-7025319a2a37" pod="opendatahub/test-curl-7212-140684077560144"
Aug 04 00:27:29.660198 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:29.660160    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42c3caa-b4b4-4136-a488-7025319a2a37" path="/var/lib/kubelet/pods/d42c3caa-b4b4-4136-a488-7025319a2a37/volumes"
Aug 04 00:27:29.793807 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:29.793761    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:29.800031 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:29.799996    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:30.555709 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:30.555678    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:30.556886 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:30.556865    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:31.453864 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:31.453829    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:31.605545 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:31.605511    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:32.575940 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:32.575908    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:33.315088 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:33.315045    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:33.369172 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:33.369137    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:35.846402 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:35.846366    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:27:45.805707 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:45.805480    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": read tcp 10.134.0.2:44072->10.134.0.67:15021: read: connection reset by peer" start-of-body=
Aug 04 00:27:45.805707 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:45.805556    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": read tcp 10.134.0.2:44072->10.134.0.67:15021: read: connection reset by peer"
Aug 04 00:27:46.649618 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:46.649580    2568 generic.go:356] "Generic (PLEG): container finished" podID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerID="c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af" exitCode=0
Aug 04 00:27:46.649805 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:46.649653    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" event={"ID":"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6","Type":"ContainerDied","Data":"c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af"}
Aug 04 00:27:46.650070 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:46.650055    2568 scope.go:117] "RemoveContainer" containerID="c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af"
Aug 04 00:27:46.651098 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:46.651070    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:27:46.651159 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:46.651139    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:27:46.651201 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:46.651172    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:27:47.661290 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:47.661235    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" event={"ID":"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6","Type":"ContainerStarted","Data":"bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8"}
Aug 04 00:27:47.793656 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:47.793617    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:47.793931 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:47.793901    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:27:47.794038 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:47.793965    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:27:48.794514 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:48.794471    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:27:48.795143 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:48.795107    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:27:49.794207 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:49.794157    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:27:49.794452 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:49.794242    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:27:50.794036 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:50.793993    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:27:50.794689 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:50.794653    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:27:51.793800 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:51.793754    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:27:51.794019 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:51.793832    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:27:52.797289 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:52.797247    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:52.797750 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:52.797737    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:52.798328 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:52.798310    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:27:56.456348 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:56.456314    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:57.123165 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.123132    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:57.387157 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.387075    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"]
Aug 04 00:27:57.390405 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.390376    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.392959 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.392931    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-f96979-openshift-default-dockercfg-lvzdk\""
Aug 04 00:27:57.403035 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.403002    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"]
Aug 04 00:27:57.419332 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.419302    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:57.513046 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.513004    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-token\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.513644 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.513086    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-certs\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.513644 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.513124    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-data\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.513644 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.513159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-socket\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.513644 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.513196    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-credential-socket\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.513644 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.513227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-envoy\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.513644 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.513290    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-podinfo\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.513644 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.513322    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcmdz\" (UniqueName: \"kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-kube-api-access-rcmdz\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.513644 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.513355    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istiod-ca-cert\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.613862 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.613825    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-token\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614036 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.613883    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-certs\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614036 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.613912    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-data\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614036 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.613942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-socket\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614036 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.613968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-credential-socket\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614036 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.613995    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-envoy\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614299 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.614078    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-podinfo\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614299 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.614124    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcmdz\" (UniqueName: \"kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-kube-api-access-rcmdz\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614299 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.614156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istiod-ca-cert\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614466 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.614409    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-data\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614529 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.614457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-socket\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614529 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.614508    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-credential-socket\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614643 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.614627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-certs\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.614980 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.614961    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istiod-ca-cert\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.616560 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.616542    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-envoy\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.616758 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.616740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-podinfo\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.622223 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.622197    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcmdz\" (UniqueName: \"kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-kube-api-access-rcmdz\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.622679 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.622663    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-token\") pod \"e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") " pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.704764 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.704675    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:57.790729 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.790538    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:27:57.846544 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.846378    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"]
Aug 04 00:27:57.849082 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:27:57.849047    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ca513b_bbba_41f9_8ea6_7c307b1e4772.slice/crio-13db8ee1820f544ad49ea6947f4070eecc15884c847e0658033b8798f65cb3da WatchSource:0}: Error finding container 13db8ee1820f544ad49ea6947f4070eecc15884c847e0658033b8798f65cb3da: Status 404 returned error can't find the container with id 13db8ee1820f544ad49ea6947f4070eecc15884c847e0658033b8798f65cb3da
Aug 04 00:27:57.851226 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.851191    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:27:57.851322 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.851279    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:27:57.851363 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:57.851333    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:27:58.716919 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:58.716873    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" event={"ID":"19ca513b-bbba-41f9-8ea6-7c307b1e4772","Type":"ContainerStarted","Data":"f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769"}
Aug 04 00:27:58.717389 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:58.716938    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" event={"ID":"19ca513b-bbba-41f9-8ea6-7c307b1e4772","Type":"ContainerStarted","Data":"13db8ee1820f544ad49ea6947f4070eecc15884c847e0658033b8798f65cb3da"}
Aug 04 00:27:58.737834 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:58.737789    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" podStartSLOduration=1.7377740510000002 podStartE2EDuration="1.737774051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:27:58.735905998 +0000 UTC m=+3479.622234460" watchObservedRunningTime="2026-08-04 00:27:58.737774051 +0000 UTC m=+3479.624102516"
Aug 04 00:27:59.705440 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:59.705404    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:59.710939 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:59.710913    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:59.722912 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:59.722887    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:27:59.723630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:27:59.723611    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:28:00.618709 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:00.618678    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:00.753558 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:00.753520    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:01.910726 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:01.910692    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:02.011830 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:02.011787    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:02.364461 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:02.364419    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:02.434353 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:02.434322    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:04.946815 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:04.946779    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:28:14.724430 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:14.724388    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:28:14.724851 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:14.724466    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:28:14.804558 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:14.804523    2568 generic.go:356] "Generic (PLEG): container finished" podID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerID="f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769" exitCode=0
Aug 04 00:28:14.804742 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:14.804599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" event={"ID":"19ca513b-bbba-41f9-8ea6-7c307b1e4772","Type":"ContainerDied","Data":"f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769"}
Aug 04 00:28:14.805009 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:14.804993    2568 scope.go:117] "RemoveContainer" containerID="f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769"
Aug 04 00:28:14.806058 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:14.806028    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:28:14.806149 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:14.806116    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:28:14.806211 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:14.806193    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:28:15.325655 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:15.325605    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:15.816542 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:15.816497    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" event={"ID":"19ca513b-bbba-41f9-8ea6-7c307b1e4772","Type":"ContainerStarted","Data":"9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625"}
Aug 04 00:28:16.705211 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:16.705175    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:28:16.705654 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:16.705556    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:28:16.705836 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:16.705811    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:28:17.706220 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:17.706180    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:28:17.706860 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:17.706825    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:28:18.705212 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:18.705173    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:28:18.705535 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:18.705504    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:28:19.705587 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:19.705498    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:28:19.706168 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:19.706136    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:28:20.705684 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:20.705645    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:28:20.706081 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:20.705718    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:28:21.709352 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:21.709321    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:28:21.709743 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:21.709598    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:28:21.710343 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:21.710322    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:28:25.552532 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:25.552490    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:33.861538 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:33.861503    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:33.927864 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:33.927829    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:36.767639 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:36.767594    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:28:39.647734 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:28:39.647695    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:29:06.141117 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:06.141074    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:29:15.572036 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.571998    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:15.846996 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.846908    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"]
Aug 04 00:29:15.849505 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.849484    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:15.851575 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.851556    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-a51f42-openshift-default-dockercfg-578vg\""
Aug 04 00:29:15.869961 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.869928    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"]
Aug 04 00:29:15.876841 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.876799    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:15.967836 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.967782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg5sg\" (UniqueName: \"kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-kube-api-access-jg5sg\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:15.968050 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.967928    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-data\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:15.968050 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.968019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-credential-socket\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:15.968185 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.968056    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-podinfo\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:15.968185 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.968117    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96db8ac7-5f86-4e55-ac7c-283772d2466a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:15.968185 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.968150    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-socket\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:15.968368 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.968218    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-certs\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:15.968368 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.968245    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-token\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:15.968368 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:15.968295    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-envoy\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.069876 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.069826    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-certs\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.069876 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.069880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-token\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.069910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-envoy\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.069938    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg5sg\" (UniqueName: \"kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-kube-api-access-jg5sg\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.070008    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-data\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.070086    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-credential-socket\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.070121    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-podinfo\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070431 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.070155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96db8ac7-5f86-4e55-ac7c-283772d2466a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070431 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.070188    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-socket\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070431 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.070310    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-certs\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070596 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.070471    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-data\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070596 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.070533    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-socket\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070710 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.070598    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-credential-socket\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.070932 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.070909    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96db8ac7-5f86-4e55-ac7c-283772d2466a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.072336 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.072317    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-envoy\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.072686 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.072668    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-podinfo\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.078212 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.078188    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-token\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.078344 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.078273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg5sg\" (UniqueName: \"kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-kube-api-access-jg5sg\") pod \"e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") " pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.166576 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.166482    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:16.190616 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.190577    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:16.314850 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.314783    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"]
Aug 04 00:29:16.317407 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:29:16.317378    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96db8ac7_5f86_4e55_ac7c_283772d2466a.slice/crio-35f5e38000a529073fec1fb8ec9d216a3e6b307fa5fd7e9bfa6584ab108256b6 WatchSource:0}: Error finding container 35f5e38000a529073fec1fb8ec9d216a3e6b307fa5fd7e9bfa6584ab108256b6: Status 404 returned error can't find the container with id 35f5e38000a529073fec1fb8ec9d216a3e6b307fa5fd7e9bfa6584ab108256b6
Aug 04 00:29:16.319693 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.319657    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:29:16.319787 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.319726    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:29:16.319787 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:16.319755    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:29:17.131045 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:17.131011    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" event={"ID":"96db8ac7-5f86-4e55-ac7c-283772d2466a","Type":"ContainerStarted","Data":"5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4"}
Aug 04 00:29:17.131445 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:17.131063    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" event={"ID":"96db8ac7-5f86-4e55-ac7c-283772d2466a","Type":"ContainerStarted","Data":"35f5e38000a529073fec1fb8ec9d216a3e6b307fa5fd7e9bfa6584ab108256b6"}
Aug 04 00:29:17.152751 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:17.152705    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" podStartSLOduration=2.152679657 podStartE2EDuration="2.152679657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:29:17.151655059 +0000 UTC m=+3558.037983525" watchObservedRunningTime="2026-08-04 00:29:17.152679657 +0000 UTC m=+3558.039008174"
Aug 04 00:29:17.167316 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:17.167280    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:17.172403 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:17.172380    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:18.136567 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:18.136530    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:18.137998 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:18.137977    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:19.022732 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:19.022699    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:19.122067 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:19.122031    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:20.313367 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:20.313324    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:20.595332 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:20.595234    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:20.820527 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:20.820488    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:20.918202 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:20.918121    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:26.246101 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:26.246053    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:29:37.250996 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:37.250958    2568 generic.go:356] "Generic (PLEG): container finished" podID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerID="5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4" exitCode=0
Aug 04 00:29:37.251476 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:37.251031    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" event={"ID":"96db8ac7-5f86-4e55-ac7c-283772d2466a","Type":"ContainerDied","Data":"5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4"}
Aug 04 00:29:37.251476 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:37.251447    2568 scope.go:117] "RemoveContainer" containerID="5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4"
Aug 04 00:29:37.252592 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:37.252565    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:29:37.252655 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:37.252629    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:29:37.252691 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:37.252665    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Aug 04 00:29:38.258124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:38.258085    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" event={"ID":"96db8ac7-5f86-4e55-ac7c-283772d2466a","Type":"ContainerStarted","Data":"d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e"}
Aug 04 00:29:39.166995 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:39.166960    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:39.167317 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:39.167291    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 00:29:39.167379 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:39.167352    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 00:29:40.167079 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:40.167044    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 00:29:40.167527 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:40.167100    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 00:29:41.167627 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:41.167587    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 00:29:41.168048 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:41.167652    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 00:29:42.167425 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:42.167385    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 00:29:42.167611 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:42.167447    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 00:29:43.167857 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:43.167811    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 00:29:43.168310 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:43.167888    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 00:29:44.004675 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:44.004611    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:44.171573 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:44.171538    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:44.171997 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:44.171792    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:44.172468 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:44.172449    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:29:50.657832 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:50.657732    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:50.727070 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:50.727033    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:50.783513 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:50.783478    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:50.842276 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:50.842221    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:51.189024 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:51.188988    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:53.643308 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:53.643255    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:29:57.155108 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:57.155079    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:57.219959 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:57.219922    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:57.388719 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:57.388631    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"]
Aug 04 00:29:57.388953 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:57.388892    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy" containerID="cri-o://d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e" gracePeriod=30
Aug 04 00:29:57.414248 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:57.414219    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:57.631376 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:57.631331    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:29:59.174499 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:59.174458    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Aug 04 00:29:59.174921 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:29:59.174542    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:30:02.644182 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.644150    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:30:02.739916 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.739878    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg5sg\" (UniqueName: \"kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-kube-api-access-jg5sg\") pod \"96db8ac7-5f86-4e55-ac7c-283772d2466a\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") "
Aug 04 00:30:02.740093 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.739926    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-envoy\") pod \"96db8ac7-5f86-4e55-ac7c-283772d2466a\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") "
Aug 04 00:30:02.740093 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.739973    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-data\") pod \"96db8ac7-5f86-4e55-ac7c-283772d2466a\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") "
Aug 04 00:30:02.740093 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.740010    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96db8ac7-5f86-4e55-ac7c-283772d2466a-istiod-ca-cert\") pod \"96db8ac7-5f86-4e55-ac7c-283772d2466a\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") "
Aug 04 00:30:02.740093 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.740052    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-podinfo\") pod \"96db8ac7-5f86-4e55-ac7c-283772d2466a\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") "
Aug 04 00:30:02.740093 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.740086    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-certs\") pod \"96db8ac7-5f86-4e55-ac7c-283772d2466a\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") "
Aug 04 00:30:02.740384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.740132    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-socket\") pod \"96db8ac7-5f86-4e55-ac7c-283772d2466a\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") "
Aug 04 00:30:02.740384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.740196    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-token\") pod \"96db8ac7-5f86-4e55-ac7c-283772d2466a\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") "
Aug 04 00:30:02.740384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.740232    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-credential-socket\") pod \"96db8ac7-5f86-4e55-ac7c-283772d2466a\" (UID: \"96db8ac7-5f86-4e55-ac7c-283772d2466a\") "
Aug 04 00:30:02.740384 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.740344    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-data" (OuterVolumeSpecName: "istio-data") pod "96db8ac7-5f86-4e55-ac7c-283772d2466a" (UID: "96db8ac7-5f86-4e55-ac7c-283772d2466a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:30:02.740603 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.740469    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "96db8ac7-5f86-4e55-ac7c-283772d2466a" (UID: "96db8ac7-5f86-4e55-ac7c-283772d2466a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:30:02.740979 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.740798    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "96db8ac7-5f86-4e55-ac7c-283772d2466a" (UID: "96db8ac7-5f86-4e55-ac7c-283772d2466a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:30:02.741082 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.741036    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96db8ac7-5f86-4e55-ac7c-283772d2466a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "96db8ac7-5f86-4e55-ac7c-283772d2466a" (UID: "96db8ac7-5f86-4e55-ac7c-283772d2466a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:30:02.741149 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.741109    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "96db8ac7-5f86-4e55-ac7c-283772d2466a" (UID: "96db8ac7-5f86-4e55-ac7c-283772d2466a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:30:02.741430 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.741407    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:30:02.741511 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.741438    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:30:02.741511 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.741454    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96db8ac7-5f86-4e55-ac7c-283772d2466a-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:30:02.741511 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.741467    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:30:02.741511 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.741479    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:30:02.742573 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.742542    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-token" (OuterVolumeSpecName: "istio-token") pod "96db8ac7-5f86-4e55-ac7c-283772d2466a" (UID: "96db8ac7-5f86-4e55-ac7c-283772d2466a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:30:02.742669 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.742570    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "96db8ac7-5f86-4e55-ac7c-283772d2466a" (UID: "96db8ac7-5f86-4e55-ac7c-283772d2466a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:30:02.742669 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.742568    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "96db8ac7-5f86-4e55-ac7c-283772d2466a" (UID: "96db8ac7-5f86-4e55-ac7c-283772d2466a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:30:02.742669 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.742626    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-kube-api-access-jg5sg" (OuterVolumeSpecName: "kube-api-access-jg5sg") pod "96db8ac7-5f86-4e55-ac7c-283772d2466a" (UID: "96db8ac7-5f86-4e55-ac7c-283772d2466a"). InnerVolumeSpecName "kube-api-access-jg5sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:30:02.843015 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.842963    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:30:02.843015 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.843008    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:30:02.843015 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.843017    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg5sg\" (UniqueName: \"kubernetes.io/projected/96db8ac7-5f86-4e55-ac7c-283772d2466a-kube-api-access-jg5sg\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:30:02.843015 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:02.843028    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96db8ac7-5f86-4e55-ac7c-283772d2466a-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:30:03.391967 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.391929    2568 generic.go:356] "Generic (PLEG): container finished" podID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerID="d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e" exitCode=0
Aug 04 00:30:03.392184 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.391988    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"
Aug 04 00:30:03.392184 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.391999    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" event={"ID":"96db8ac7-5f86-4e55-ac7c-283772d2466a","Type":"ContainerDied","Data":"d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e"}
Aug 04 00:30:03.392184 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.392050    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f" event={"ID":"96db8ac7-5f86-4e55-ac7c-283772d2466a","Type":"ContainerDied","Data":"35f5e38000a529073fec1fb8ec9d216a3e6b307fa5fd7e9bfa6584ab108256b6"}
Aug 04 00:30:03.392184 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.392072    2568 scope.go:117] "RemoveContainer" containerID="d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e"
Aug 04 00:30:03.402016 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.401994    2568 scope.go:117] "RemoveContainer" containerID="5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4"
Aug 04 00:30:03.410474 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.410453    2568 scope.go:117] "RemoveContainer" containerID="d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e"
Aug 04 00:30:03.410758 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:30:03.410738    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e\": container with ID starting with d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e not found: ID does not exist" containerID="d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e"
Aug 04 00:30:03.410803 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.410770    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e"} err="failed to get container status \"d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e\": rpc error: code = NotFound desc = could not find container \"d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e\": container with ID starting with d2e7d63dfba608454187e64b37c1cf65afda1680afb3d19565ab958a32d3969e not found: ID does not exist"
Aug 04 00:30:03.410803 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.410790    2568 scope.go:117] "RemoveContainer" containerID="5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4"
Aug 04 00:30:03.411035 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:30:03.411018    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4\": container with ID starting with 5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4 not found: ID does not exist" containerID="5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4"
Aug 04 00:30:03.411072 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.411042    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4"} err="failed to get container status \"5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4\": rpc error: code = NotFound desc = could not find container \"5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4\": container with ID starting with 5337659cc7eaa4b98be6d8074cae935dd274d65ba7899a4c73f55987de1cbcf4 not found: ID does not exist"
Aug 04 00:30:03.414326 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.414304    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"]
Aug 04 00:30:03.417676 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.417657    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a51f42-openshift-default-6f946f86c8-csj5f"]
Aug 04 00:30:03.660834 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:03.660744    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" path="/var/lib/kubelet/pods/96db8ac7-5f86-4e55-ac7c-283772d2466a/volumes"
Aug 04 00:30:04.361509 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:04.361473    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6"]
Aug 04 00:30:04.365120 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:04.365091    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763345-vzxs6"]
Aug 04 00:30:05.660244 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:05.660209    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="086f785e-7eac-4e57-91be-1a029e3d61a0" path="/var/lib/kubelet/pods/086f785e-7eac-4e57-91be-1a029e3d61a0/volumes"
Aug 04 00:30:14.347630 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:14.347593    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:30:14.489287 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:14.489227    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:30:16.584059 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:16.584026    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:30:16.637466 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:16.637425    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:30:16.987612 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:16.987542    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:30:17.178074 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:17.178017    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:30:17.389380 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:17.389291    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:30:22.013276 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:22.013229    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:30:23.740039 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:23.739996    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:30:51.580646 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:51.580607    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:30:51.632750 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:51.632715    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:30:58.719610 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:58.719574    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:30:59.265819 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:30:59.265785    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:00.028947 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:00.028912    2568 scope.go:117] "RemoveContainer" containerID="aa9261f0a52db96e56300e2ba11bf999767463e090d8516d730037e0e52c02d9"
Aug 04 00:31:05.175239 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:05.175199    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:05.234073 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:05.234037    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:05.426903 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:05.426804    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"]
Aug 04 00:31:05.427126 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:05.427089    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy" containerID="cri-o://bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8" gracePeriod=30
Aug 04 00:31:05.450116 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:05.450075    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:05.677444 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:05.677361    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:07.800834 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:07.800787    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 00:31:07.801238 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:07.800869    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:31:10.686473 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.686442    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:31:10.736459 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.736424    2568 generic.go:356] "Generic (PLEG): container finished" podID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerID="bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8" exitCode=0
Aug 04 00:31:10.736672 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.736474    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"
Aug 04 00:31:10.736672 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.736511    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" event={"ID":"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6","Type":"ContainerDied","Data":"bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8"}
Aug 04 00:31:10.736672 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.736577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg" event={"ID":"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6","Type":"ContainerDied","Data":"194e910a0ee18d06341398779a7bdca3c75ae5a1e2ef58f8a29fa6aa4708f9e5"}
Aug 04 00:31:10.736672 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.736608    2568 scope.go:117] "RemoveContainer" containerID="bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8"
Aug 04 00:31:10.745656 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.745635    2568 scope.go:117] "RemoveContainer" containerID="c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af"
Aug 04 00:31:10.754429 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.754409    2568 scope.go:117] "RemoveContainer" containerID="bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8"
Aug 04 00:31:10.754758 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:31:10.754737    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8\": container with ID starting with bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8 not found: ID does not exist" containerID="bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8"
Aug 04 00:31:10.754821 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.754767    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8"} err="failed to get container status \"bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8\": rpc error: code = NotFound desc = could not find container \"bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8\": container with ID starting with bde1b19c996bc972207f813754b6eba95ab526266666ee2e7256834eb5c29dd8 not found: ID does not exist"
Aug 04 00:31:10.754821 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.754787    2568 scope.go:117] "RemoveContainer" containerID="c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af"
Aug 04 00:31:10.755085 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:31:10.755067    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af\": container with ID starting with c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af not found: ID does not exist" containerID="c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af"
Aug 04 00:31:10.755146 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.755093    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af"} err="failed to get container status \"c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af\": rpc error: code = NotFound desc = could not find container \"c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af\": container with ID starting with c6dce23d5239cb2a632763a7c2d89fd0950ee14c9f634cae139910c5fed704af not found: ID does not exist"
Aug 04 00:31:10.816999 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.816956    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-socket\") pod \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") "
Aug 04 00:31:10.817192 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817046    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x4cl\" (UniqueName: \"kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-kube-api-access-8x4cl\") pod \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") "
Aug 04 00:31:10.817192 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817081    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istiod-ca-cert\") pod \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") "
Aug 04 00:31:10.817192 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817132    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-data\") pod \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") "
Aug 04 00:31:10.817192 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817157    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-envoy\") pod \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") "
Aug 04 00:31:10.817192 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817181    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-podinfo\") pod \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") "
Aug 04 00:31:10.817495 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817282    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-credential-socket\") pod \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") "
Aug 04 00:31:10.817495 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817318    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-token\") pod \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") "
Aug 04 00:31:10.817495 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817316    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" (UID: "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:10.817495 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817375    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-certs\") pod \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\" (UID: \"c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6\") "
Aug 04 00:31:10.817684 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817564    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" (UID: "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:10.817684 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817579    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" (UID: "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:10.817795 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817780    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" (UID: "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:10.817795 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817784    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:10.817907 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817806    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:10.817907 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817821    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:10.818002 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.817924    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" (UID: "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:31:10.819581 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.819553    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" (UID: "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:10.819714 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.819655    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" (UID: "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:31:10.820021 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.820001    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-kube-api-access-8x4cl" (OuterVolumeSpecName: "kube-api-access-8x4cl") pod "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" (UID: "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6"). InnerVolumeSpecName "kube-api-access-8x4cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:31:10.820104 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.820011    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" (UID: "c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:31:10.919339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.919301    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:10.919339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.919335    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:10.919339 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.919349    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x4cl\" (UniqueName: \"kubernetes.io/projected/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-kube-api-access-8x4cl\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:10.919607 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.919362    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:10.919607 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.919372    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:10.919607 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:10.919383    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:11.058731 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:11.058699    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"]
Aug 04 00:31:11.065280 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:11.065221    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-8c194a-openshift-default-58496cd9cd-wqsmg"]
Aug 04 00:31:11.660453 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:11.660422    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" path="/var/lib/kubelet/pods/c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6/volumes"
Aug 04 00:31:16.324436 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:16.324401    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:16.383170 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:16.383130    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:16.484688 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:16.484651    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:16.549844 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:16.549807    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:17.000057 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:16.999984    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:18.554170 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:18.554125    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:31:23.090051 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:23.089973    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:23.190540 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:23.190498    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:23.228700 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:23.228665    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"]
Aug 04 00:31:23.228908 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:23.228882    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy" containerID="cri-o://9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625" gracePeriod=30
Aug 04 00:31:23.254136 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:23.254092    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:23.464315 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:23.464204    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:28.505081 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.505014    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:31:28.584712 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.584672    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-credential-socket\") pod \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") "
Aug 04 00:31:28.584712 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.584717    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istiod-ca-cert\") pod \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") "
Aug 04 00:31:28.584962 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.584749    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-podinfo\") pod \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") "
Aug 04 00:31:28.584962 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.584768    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-envoy\") pod \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") "
Aug 04 00:31:28.584962 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.584784    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-socket\") pod \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") "
Aug 04 00:31:28.584962 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.584911    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-certs\") pod \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") "
Aug 04 00:31:28.585169 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.584985    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-data\") pod \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") "
Aug 04 00:31:28.585169 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585020    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcmdz\" (UniqueName: \"kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-kube-api-access-rcmdz\") pod \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") "
Aug 04 00:31:28.585169 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585058    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-token\") pod \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\" (UID: \"19ca513b-bbba-41f9-8ea6-7c307b1e4772\") "
Aug 04 00:31:28.585169 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585084    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19ca513b-bbba-41f9-8ea6-7c307b1e4772" (UID: "19ca513b-bbba-41f9-8ea6-7c307b1e4772"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:28.585418 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585195    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19ca513b-bbba-41f9-8ea6-7c307b1e4772" (UID: "19ca513b-bbba-41f9-8ea6-7c307b1e4772"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:28.585418 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585228    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19ca513b-bbba-41f9-8ea6-7c307b1e4772" (UID: "19ca513b-bbba-41f9-8ea6-7c307b1e4772"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:31:28.585418 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585340    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19ca513b-bbba-41f9-8ea6-7c307b1e4772" (UID: "19ca513b-bbba-41f9-8ea6-7c307b1e4772"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:28.585418 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585355    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-data" (OuterVolumeSpecName: "istio-data") pod "19ca513b-bbba-41f9-8ea6-7c307b1e4772" (UID: "19ca513b-bbba-41f9-8ea6-7c307b1e4772"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:28.585591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585476    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:28.585591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585495    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:28.585591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585509    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:28.585591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585522    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:28.585591 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.585534    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:28.587424 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.587399    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-token" (OuterVolumeSpecName: "istio-token") pod "19ca513b-bbba-41f9-8ea6-7c307b1e4772" (UID: "19ca513b-bbba-41f9-8ea6-7c307b1e4772"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:31:28.587539 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.587459    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-kube-api-access-rcmdz" (OuterVolumeSpecName: "kube-api-access-rcmdz") pod "19ca513b-bbba-41f9-8ea6-7c307b1e4772" (UID: "19ca513b-bbba-41f9-8ea6-7c307b1e4772"). InnerVolumeSpecName "kube-api-access-rcmdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:31:28.587672 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.587649    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19ca513b-bbba-41f9-8ea6-7c307b1e4772" (UID: "19ca513b-bbba-41f9-8ea6-7c307b1e4772"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:31:28.587758 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.587666    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19ca513b-bbba-41f9-8ea6-7c307b1e4772" (UID: "19ca513b-bbba-41f9-8ea6-7c307b1e4772"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:28.686714 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.686681    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:28.686714 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.686709    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:28.686714 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.686719    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcmdz\" (UniqueName: \"kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-kube-api-access-rcmdz\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:28.686957 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.686732    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ca513b-bbba-41f9-8ea6-7c307b1e4772-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:28.829104 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.829010    2568 generic.go:356] "Generic (PLEG): container finished" podID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerID="9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625" exitCode=0
Aug 04 00:31:28.829104 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.829056    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"
Aug 04 00:31:28.829406 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.829099    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" event={"ID":"19ca513b-bbba-41f9-8ea6-7c307b1e4772","Type":"ContainerDied","Data":"9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625"}
Aug 04 00:31:28.829406 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.829163    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd" event={"ID":"19ca513b-bbba-41f9-8ea6-7c307b1e4772","Type":"ContainerDied","Data":"13db8ee1820f544ad49ea6947f4070eecc15884c847e0658033b8798f65cb3da"}
Aug 04 00:31:28.829406 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.829194    2568 scope.go:117] "RemoveContainer" containerID="9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625"
Aug 04 00:31:28.839072 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.839053    2568 scope.go:117] "RemoveContainer" containerID="f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769"
Aug 04 00:31:28.847813 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.847796    2568 scope.go:117] "RemoveContainer" containerID="9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625"
Aug 04 00:31:28.848086 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:31:28.848070    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625\": container with ID starting with 9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625 not found: ID does not exist" containerID="9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625"
Aug 04 00:31:28.848132 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.848094    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625"} err="failed to get container status \"9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625\": rpc error: code = NotFound desc = could not find container \"9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625\": container with ID starting with 9f573d4ddb89e00239e5fab1787b131e8215d6850dcdeff47a6bc408dea3f625 not found: ID does not exist"
Aug 04 00:31:28.848132 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.848109    2568 scope.go:117] "RemoveContainer" containerID="f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769"
Aug 04 00:31:28.848331 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:31:28.848314    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769\": container with ID starting with f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769 not found: ID does not exist" containerID="f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769"
Aug 04 00:31:28.848405 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.848335    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769"} err="failed to get container status \"f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769\": rpc error: code = NotFound desc = could not find container \"f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769\": container with ID starting with f831858ef1eae24759ab5750b809f00d1245d3d54febaf7ba15092e4664c9769 not found: ID does not exist"
Aug 04 00:31:28.851929 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.851902    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"]
Aug 04 00:31:28.855668 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:28.855645    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-f96979-openshift-default-6b6dbbd8dd-6v2pd"]
Aug 04 00:31:29.659948 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:29.659914    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" path="/var/lib/kubelet/pods/19ca513b-bbba-41f9-8ea6-7c307b1e4772/volumes"
Aug 04 00:31:34.031624 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:34.031587    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:34.109488 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:34.109454    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:34.172230 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:34.172193    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:34.271239 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:34.271198    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:34.582055 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:34.582025    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:36.243523 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:36.243484    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:31:40.727963 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:40.727919    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:40.828498 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:40.828464    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:40.970642 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:40.970601    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"]
Aug 04 00:31:40.970855 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:40.970828    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy" containerID="cri-o://a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41" gracePeriod=30
Aug 04 00:31:40.990940 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:40.990854    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:41.237018 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.236983    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:41.334782 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.334702    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"]
Aug 04 00:31:41.335065 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335051    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy"
Aug 04 00:31:41.335109 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335066    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy"
Aug 04 00:31:41.335109 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335075    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy"
Aug 04 00:31:41.335109 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335080    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy"
Aug 04 00:31:41.335109 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335089    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy"
Aug 04 00:31:41.335109 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335095    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy"
Aug 04 00:31:41.335109 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335102    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy"
Aug 04 00:31:41.335109 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335107    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy"
Aug 04 00:31:41.335354 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335114    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy"
Aug 04 00:31:41.335354 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335119    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy"
Aug 04 00:31:41.335354 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335179    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy"
Aug 04 00:31:41.335354 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335187    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy"
Aug 04 00:31:41.335354 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335192    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy"
Aug 04 00:31:41.335354 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.335198    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="96db8ac7-5f86-4e55-ac7c-283772d2466a" containerName="istio-proxy"
Aug 04 00:31:41.339701 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.339681    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"
Aug 04 00:31:41.342166 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.341933    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9x6w2\""
Aug 04 00:31:41.342166 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.341960    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:31:41.344573 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.344545    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"]
Aug 04 00:31:41.402914 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.402875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebbab86-ba8b-4609-8c1c-879f6aeb36d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8\" (UID: \"7ebbab86-ba8b-4609-8c1c-879f6aeb36d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"
Aug 04 00:31:41.504371 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.504331    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebbab86-ba8b-4609-8c1c-879f6aeb36d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8\" (UID: \"7ebbab86-ba8b-4609-8c1c-879f6aeb36d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"
Aug 04 00:31:41.504972 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.504954    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebbab86-ba8b-4609-8c1c-879f6aeb36d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8\" (UID: \"7ebbab86-ba8b-4609-8c1c-879f6aeb36d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"
Aug 04 00:31:41.652712 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.652616    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"
Aug 04 00:31:41.789304 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.789252    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"]
Aug 04 00:31:41.792286 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:31:41.792229    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ebbab86_ba8b_4609_8c1c_879f6aeb36d7.slice/crio-9fe551ff0e5f6a0f1cd16552d6260b42e6cacf252424e37112323e2449ec7ecf WatchSource:0}: Error finding container 9fe551ff0e5f6a0f1cd16552d6260b42e6cacf252424e37112323e2449ec7ecf: Status 404 returned error can't find the container with id 9fe551ff0e5f6a0f1cd16552d6260b42e6cacf252424e37112323e2449ec7ecf
Aug 04 00:31:41.902373 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:41.902334    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8" event={"ID":"7ebbab86-ba8b-4609-8c1c-879f6aeb36d7","Type":"ContainerStarted","Data":"9fe551ff0e5f6a0f1cd16552d6260b42e6cacf252424e37112323e2449ec7ecf"}
Aug 04 00:31:42.908458 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:42.908354    2568 generic.go:356] "Generic (PLEG): container finished" podID="7ebbab86-ba8b-4609-8c1c-879f6aeb36d7" containerID="2b21ebc2facbd2df48fab7b19845172bff33afe1f104aca68ec12d4a15e0e2c9" exitCode=0
Aug 04 00:31:42.908833 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:42.908449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8" event={"ID":"7ebbab86-ba8b-4609-8c1c-879f6aeb36d7","Type":"ContainerDied","Data":"2b21ebc2facbd2df48fab7b19845172bff33afe1f104aca68ec12d4a15e0e2c9"}
Aug 04 00:31:43.732426 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:43.732390    2568 patch_prober.go:28] interesting pod/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 00:31:43.732603 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:43.732461    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:31:44.049639 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:44.049610    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"
Aug 04 00:31:44.129069 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:44.129030    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebbab86-ba8b-4609-8c1c-879f6aeb36d7-maas-api-service-ca\") pod \"7ebbab86-ba8b-4609-8c1c-879f6aeb36d7\" (UID: \"7ebbab86-ba8b-4609-8c1c-879f6aeb36d7\") "
Aug 04 00:31:44.129430 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:44.129407    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ebbab86-ba8b-4609-8c1c-879f6aeb36d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ebbab86-ba8b-4609-8c1c-879f6aeb36d7" (UID: "7ebbab86-ba8b-4609-8c1c-879f6aeb36d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:31:44.230080 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:44.230041    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebbab86-ba8b-4609-8c1c-879f6aeb36d7-maas-api-service-ca\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:44.919323 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:44.919290    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8" event={"ID":"7ebbab86-ba8b-4609-8c1c-879f6aeb36d7","Type":"ContainerDied","Data":"9fe551ff0e5f6a0f1cd16552d6260b42e6cacf252424e37112323e2449ec7ecf"}
Aug 04 00:31:44.919530 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:44.919339    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fe551ff0e5f6a0f1cd16552d6260b42e6cacf252424e37112323e2449ec7ecf"
Aug 04 00:31:44.919530 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:44.919342    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"
Aug 04 00:31:46.223520 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.223497    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:31:46.348646 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.348555    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485d9705-f129-465b-8b42-db7bafc309e6-istio-podinfo\") pod \"485d9705-f129-465b-8b42-db7bafc309e6\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") "
Aug 04 00:31:46.348646 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.348633    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-certs\") pod \"485d9705-f129-465b-8b42-db7bafc309e6\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") "
Aug 04 00:31:46.348879 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.348654    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-envoy\") pod \"485d9705-f129-465b-8b42-db7bafc309e6\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") "
Aug 04 00:31:46.348879 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.348678    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsdwq\" (UniqueName: \"kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-kube-api-access-gsdwq\") pod \"485d9705-f129-465b-8b42-db7bafc309e6\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") "
Aug 04 00:31:46.348879 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.348702    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-socket\") pod \"485d9705-f129-465b-8b42-db7bafc309e6\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") "
Aug 04 00:31:46.348879 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.348744    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-istio-token\") pod \"485d9705-f129-465b-8b42-db7bafc309e6\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") "
Aug 04 00:31:46.348879 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.348784    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-data\") pod \"485d9705-f129-465b-8b42-db7bafc309e6\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") "
Aug 04 00:31:46.348879 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.348833    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-credential-socket\") pod \"485d9705-f129-465b-8b42-db7bafc309e6\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") "
Aug 04 00:31:46.348879 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.348865    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485d9705-f129-465b-8b42-db7bafc309e6-istiod-ca-cert\") pod \"485d9705-f129-465b-8b42-db7bafc309e6\" (UID: \"485d9705-f129-465b-8b42-db7bafc309e6\") "
Aug 04 00:31:46.349286 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.349232    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "485d9705-f129-465b-8b42-db7bafc309e6" (UID: "485d9705-f129-465b-8b42-db7bafc309e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:46.349286 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.349244    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "485d9705-f129-465b-8b42-db7bafc309e6" (UID: "485d9705-f129-465b-8b42-db7bafc309e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:46.349422 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.349357    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "485d9705-f129-465b-8b42-db7bafc309e6" (UID: "485d9705-f129-465b-8b42-db7bafc309e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:46.349643 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.349456    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485d9705-f129-465b-8b42-db7bafc309e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "485d9705-f129-465b-8b42-db7bafc309e6" (UID: "485d9705-f129-465b-8b42-db7bafc309e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:31:46.349716 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.349692    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "485d9705-f129-465b-8b42-db7bafc309e6" (UID: "485d9705-f129-465b-8b42-db7bafc309e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:46.351079 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.351050    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-kube-api-access-gsdwq" (OuterVolumeSpecName: "kube-api-access-gsdwq") pod "485d9705-f129-465b-8b42-db7bafc309e6" (UID: "485d9705-f129-465b-8b42-db7bafc309e6"). InnerVolumeSpecName "kube-api-access-gsdwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:31:46.351193 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.351145    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/485d9705-f129-465b-8b42-db7bafc309e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "485d9705-f129-465b-8b42-db7bafc309e6" (UID: "485d9705-f129-465b-8b42-db7bafc309e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:31:46.351550 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.351522    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "485d9705-f129-465b-8b42-db7bafc309e6" (UID: "485d9705-f129-465b-8b42-db7bafc309e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:31:46.351550 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.351534    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "485d9705-f129-465b-8b42-db7bafc309e6" (UID: "485d9705-f129-465b-8b42-db7bafc309e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:31:46.450531 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.450491    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485d9705-f129-465b-8b42-db7bafc309e6-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:46.450531 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.450524    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:46.450531 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.450533    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:46.450531 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.450542    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsdwq\" (UniqueName: \"kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-kube-api-access-gsdwq\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:46.450810 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.450552    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:46.450810 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.450560    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485d9705-f129-465b-8b42-db7bafc309e6-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:46.450810 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.450568    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:46.450810 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.450575    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485d9705-f129-465b-8b42-db7bafc309e6-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:46.450810 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.450582    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485d9705-f129-465b-8b42-db7bafc309e6-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:31:46.935201 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.935168    2568 generic.go:356] "Generic (PLEG): container finished" podID="485d9705-f129-465b-8b42-db7bafc309e6" containerID="a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41" exitCode=0
Aug 04 00:31:46.935405 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.935217    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"
Aug 04 00:31:46.935405 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.935251    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" event={"ID":"485d9705-f129-465b-8b42-db7bafc309e6","Type":"ContainerDied","Data":"a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41"}
Aug 04 00:31:46.935405 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.935331    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8" event={"ID":"485d9705-f129-465b-8b42-db7bafc309e6","Type":"ContainerDied","Data":"d47ab9a8918d0ddb65f983e3da1f6db9da196f300f28dcb3fda68d4093b89753"}
Aug 04 00:31:46.935405 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.935355    2568 scope.go:117] "RemoveContainer" containerID="a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41"
Aug 04 00:31:46.945444 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.945417    2568 scope.go:117] "RemoveContainer" containerID="4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40"
Aug 04 00:31:46.954178 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.954149    2568 scope.go:117] "RemoveContainer" containerID="a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41"
Aug 04 00:31:46.954620 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:31:46.954592    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41\": container with ID starting with a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41 not found: ID does not exist" containerID="a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41"
Aug 04 00:31:46.954709 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.954635    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41"} err="failed to get container status \"a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41\": rpc error: code = NotFound desc = could not find container \"a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41\": container with ID starting with a6b34f8eb04788d1f249c62d7c633398bdf0565f93fe64783368a21618616c41 not found: ID does not exist"
Aug 04 00:31:46.954709 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.954688    2568 scope.go:117] "RemoveContainer" containerID="4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40"
Aug 04 00:31:46.955121 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:31:46.955045    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40\": container with ID starting with 4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40 not found: ID does not exist" containerID="4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40"
Aug 04 00:31:46.955121 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.955084    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40"} err="failed to get container status \"4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40\": rpc error: code = NotFound desc = could not find container \"4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40\": container with ID starting with 4bf5cc493417b4badc0f2663a21d87df11255beb5d6d2cb66e7d3931be265c40 not found: ID does not exist"
Aug 04 00:31:46.957138 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.957113    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"]
Aug 04 00:31:46.958733 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:46.958714    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-1769a3-openshift-default-85fb6bcf8d-62vj8"]
Aug 04 00:31:47.660601 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:47.660565    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="485d9705-f129-465b-8b42-db7bafc309e6" path="/var/lib/kubelet/pods/485d9705-f129-465b-8b42-db7bafc309e6/volumes"
Aug 04 00:31:51.746662 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:51.746627    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:51.826940 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:51.826908    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:51.885603 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:51.885566    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:51.916988 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:51.916940    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"]
Aug 04 00:31:51.919500 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:51.919472    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98f978-dzwc8"]
Aug 04 00:31:51.943084 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:51.943048    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:52.286558 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:52.286522    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:53.660687 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:53.660652    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ebbab86-ba8b-4609-8c1c-879f6aeb36d7" path="/var/lib/kubelet/pods/7ebbab86-ba8b-4609-8c1c-879f6aeb36d7/volumes"
Aug 04 00:31:53.939534 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:53.939445    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bbwgk"]
Aug 04 00:31:58.315061 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:58.315023    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:58.415651 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:58.415620    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:58.547488 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:58.547450    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"]
Aug 04 00:31:58.547791 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:58.547758    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy" containerID="cri-o://abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed" gracePeriod=30
Aug 04 00:31:58.566914 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:58.566844    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:58.777139 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:58.777106    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:31:59.216669 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:31:59.216629    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fd9f45b89-bbb62_b76cf502-aaba-43cf-8402-219e07de6521/authorino/0.log"
Aug 04 00:32:03.810041 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.810012    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:32:03.913457 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913367    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8xzq\" (UniqueName: \"kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-kube-api-access-l8xzq\") pod \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") "
Aug 04 00:32:03.913457 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913409    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-token\") pod \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") "
Aug 04 00:32:03.913457 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913444    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-socket\") pod \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") "
Aug 04 00:32:03.913715 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913566    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-data\") pod \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") "
Aug 04 00:32:03.913715 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913627    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-credential-socket\") pod \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") "
Aug 04 00:32:03.913715 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913670    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istiod-ca-cert\") pod \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") "
Aug 04 00:32:03.913715 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913700    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-podinfo\") pod \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") "
Aug 04 00:32:03.913715 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913707    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d98caa13-e8ae-4ccc-a18a-35f0172d4787" (UID: "d98caa13-e8ae-4ccc-a18a-35f0172d4787"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:32:03.913973 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913740    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-envoy\") pod \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") "
Aug 04 00:32:03.913973 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913777    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-certs\") pod \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\" (UID: \"d98caa13-e8ae-4ccc-a18a-35f0172d4787\") "
Aug 04 00:32:03.913973 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.913930    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d98caa13-e8ae-4ccc-a18a-35f0172d4787" (UID: "d98caa13-e8ae-4ccc-a18a-35f0172d4787"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:32:03.914128 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.914037    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d98caa13-e8ae-4ccc-a18a-35f0172d4787" (UID: "d98caa13-e8ae-4ccc-a18a-35f0172d4787"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:32:03.914187 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.914138    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:32:03.914187 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.914146    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d98caa13-e8ae-4ccc-a18a-35f0172d4787" (UID: "d98caa13-e8ae-4ccc-a18a-35f0172d4787"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:32:03.914187 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.914160    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-credential-socket\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:32:03.914187 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.914177    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istiod-ca-cert\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:32:03.914418 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.914360    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-data" (OuterVolumeSpecName: "istio-data") pod "d98caa13-e8ae-4ccc-a18a-35f0172d4787" (UID: "d98caa13-e8ae-4ccc-a18a-35f0172d4787"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:32:03.915970 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.915941    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-token" (OuterVolumeSpecName: "istio-token") pod "d98caa13-e8ae-4ccc-a18a-35f0172d4787" (UID: "d98caa13-e8ae-4ccc-a18a-35f0172d4787"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:32:03.916087 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.915990    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-kube-api-access-l8xzq" (OuterVolumeSpecName: "kube-api-access-l8xzq") pod "d98caa13-e8ae-4ccc-a18a-35f0172d4787" (UID: "d98caa13-e8ae-4ccc-a18a-35f0172d4787"). InnerVolumeSpecName "kube-api-access-l8xzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:32:03.916402 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.916380    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d98caa13-e8ae-4ccc-a18a-35f0172d4787" (UID: "d98caa13-e8ae-4ccc-a18a-35f0172d4787"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:32:03.916402 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:03.916386    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d98caa13-e8ae-4ccc-a18a-35f0172d4787" (UID: "d98caa13-e8ae-4ccc-a18a-35f0172d4787"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:32:04.015533 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.015484    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-token\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:32:04.015533 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.015530    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-data\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:32:04.015533 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.015539    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-podinfo\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:32:04.015791 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.015546    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-istio-envoy\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:32:04.015791 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.015557    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98caa13-e8ae-4ccc-a18a-35f0172d4787-workload-certs\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:32:04.015791 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.015565    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8xzq\" (UniqueName: \"kubernetes.io/projected/d98caa13-e8ae-4ccc-a18a-35f0172d4787-kube-api-access-l8xzq\") on node \"ip-10-0-138-58.ec2.internal\" DevicePath \"\""
Aug 04 00:32:04.026298 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.026249    2568 generic.go:356] "Generic (PLEG): container finished" podID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerID="abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed" exitCode=0
Aug 04 00:32:04.026298 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.026285    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" event={"ID":"d98caa13-e8ae-4ccc-a18a-35f0172d4787","Type":"ContainerDied","Data":"abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed"}
Aug 04 00:32:04.026490 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.026329    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"
Aug 04 00:32:04.026490 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.026342    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g" event={"ID":"d98caa13-e8ae-4ccc-a18a-35f0172d4787","Type":"ContainerDied","Data":"14b5468eceef58199e9d0b7e9c0ec1132cd094c944726abe08e6afb0fcd1e2f6"}
Aug 04 00:32:04.026490 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.026367    2568 scope.go:117] "RemoveContainer" containerID="abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed"
Aug 04 00:32:04.035753 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.035732    2568 scope.go:117] "RemoveContainer" containerID="bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0"
Aug 04 00:32:04.044343 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.044321    2568 scope.go:117] "RemoveContainer" containerID="abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed"
Aug 04 00:32:04.044662 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:32:04.044640    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed\": container with ID starting with abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed not found: ID does not exist" containerID="abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed"
Aug 04 00:32:04.044715 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.044673    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed"} err="failed to get container status \"abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed\": rpc error: code = NotFound desc = could not find container \"abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed\": container with ID starting with abcc916ade48a31e39cd27c9d1ad251b026894dc8edf8d8c0971941bd896c2ed not found: ID does not exist"
Aug 04 00:32:04.044715 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.044692    2568 scope.go:117] "RemoveContainer" containerID="bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0"
Aug 04 00:32:04.044947 ip-10-0-138-58 kubenswrapper[2568]: E0804 00:32:04.044931    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0\": container with ID starting with bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0 not found: ID does not exist" containerID="bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0"
Aug 04 00:32:04.045007 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.044953    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0"} err="failed to get container status \"bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0\": rpc error: code = NotFound desc = could not find container \"bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0\": container with ID starting with bf5b82f8b1a5b69d46af15d93a4256c93d933da3924b11daffd43bcf2b258fb0 not found: ID does not exist"
Aug 04 00:32:04.047475 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.047451    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"]
Aug 04 00:32:04.053569 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.053547    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-98f978-openshift-default-7cdc65fbd8-55v8g"]
Aug 04 00:32:04.349746 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.349708    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rtpmm_e93b1aba-b926-4e19-992d-bdbd82583c17/manager/0.log"
Aug 04 00:32:04.469010 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.468976    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7qfk5_1da8cc91-c2c3-4c57-a474-8029cbd5a735/manager/0.log"
Aug 04 00:32:04.706100 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.706028    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nhkdm_14ba5146-56fc-49c2-b642-f7c9e0b70b73/server/0.log"
Aug 04 00:32:04.948857 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.948826    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6869c6d9bb-5cbq2_5392f3bc-4613-468d-848c-a0dadf73a3e6/manager/0.log"
Aug 04 00:32:04.959928 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:04.959860    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6869c6d9bb-5cbq2_5392f3bc-4613-468d-848c-a0dadf73a3e6/copy-manifests/0.log"
Aug 04 00:32:05.613174 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:05.613139    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29763360-4wzps_3662e598-2c86-4c21-9b6e-8dfec37c26e6/cleanup/0.log"
Aug 04 00:32:05.660796 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:05.660749    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" path="/var/lib/kubelet/pods/d98caa13-e8ae-4ccc-a18a-35f0172d4787/volumes"
Aug 04 00:32:06.685556 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:06.685518    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fd9f45b89-bbb62_b76cf502-aaba-43cf-8402-219e07de6521/authorino/0.log"
Aug 04 00:32:06.794483 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:06.794445    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-x26hc_3ea39c69-4ec6-41d5-8244-fabee7f42804/manager/0.log"
Aug 04 00:32:06.898599 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:06.898567    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-j6gkh_2292371f-07b4-4ebc-ac50-5a2b99368697/manager/0.log"
Aug 04 00:32:07.130456 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:07.130419    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-k8hv9_9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18/manager/0.log"
Aug 04 00:32:07.239317 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:07.239291    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-bbwgk_1b0c09eb-99c4-4ea4-9688-db51fc584b42/limitador/0.log"
Aug 04 00:32:07.690866 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:07.690835    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c75zgs_af9db11d-b10d-4d77-9e23-66cdbb999ad9/istio-proxy/0.log"
Aug 04 00:32:07.930045 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:07.930017    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd58c6859-c8gpm_23bc3e97-b882-4e74-866a-40c3f2bc9d51/kube-auth-proxy/0.log"
Aug 04 00:32:08.150800 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:08.150770    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mxp6r_097c62e4-1209-4de6-83c5-5b6edf3bc128/istio-proxy/1.log"
Aug 04 00:32:09.377712 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:09.377682    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-htrsg_48da21b6-8905-4e33-9896-7500af2c9f89/main/0.log"
Aug 04 00:32:14.992467 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992432    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b95cg/must-gather-678j9"]
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992767    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992778    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992787    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992796    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992803    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992810    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992821    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992826    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992835    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992840    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992849    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ebbab86-ba8b-4609-8c1c-879f6aeb36d7" containerName="revoke-keys"
Aug 04 00:32:14.992870 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992854    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ebbab86-ba8b-4609-8c1c-879f6aeb36d7" containerName="revoke-keys"
Aug 04 00:32:14.993238 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992902    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ebbab86-ba8b-4609-8c1c-879f6aeb36d7" containerName="revoke-keys"
Aug 04 00:32:14.993238 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992910    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy"
Aug 04 00:32:14.993238 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992916    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy"
Aug 04 00:32:14.993238 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992924    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d98caa13-e8ae-4ccc-a18a-35f0172d4787" containerName="istio-proxy"
Aug 04 00:32:14.993238 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992930    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="485d9705-f129-465b-8b42-db7bafc309e6" containerName="istio-proxy"
Aug 04 00:32:14.993238 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992935    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1a5cc10-dd83-46d4-b3c7-0b512e1ffff6" containerName="istio-proxy"
Aug 04 00:32:14.993238 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.992940    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ca513b-bbba-41f9-8ea6-7c307b1e4772" containerName="istio-proxy"
Aug 04 00:32:14.995899 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.995875    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b95cg/must-gather-678j9"
Aug 04 00:32:14.998590 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.998564    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b95cg\"/\"kube-root-ca.crt\""
Aug 04 00:32:14.998691 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.998675    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b95cg\"/\"default-dockercfg-zqc6c\""
Aug 04 00:32:14.998766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:14.998741    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b95cg\"/\"openshift-service-ca.crt\""
Aug 04 00:32:15.005749 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.005722    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b95cg/must-gather-678j9"]
Aug 04 00:32:15.009025 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.008997    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:32:15.108697 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.108659    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78mcl\" (UniqueName: \"kubernetes.io/projected/103d0398-33de-44f7-b841-8c74822e8272-kube-api-access-78mcl\") pod \"must-gather-678j9\" (UID: \"103d0398-33de-44f7-b841-8c74822e8272\") " pod="openshift-must-gather-b95cg/must-gather-678j9"
Aug 04 00:32:15.108885 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.108724    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/103d0398-33de-44f7-b841-8c74822e8272-must-gather-output\") pod \"must-gather-678j9\" (UID: \"103d0398-33de-44f7-b841-8c74822e8272\") " pod="openshift-must-gather-b95cg/must-gather-678j9"
Aug 04 00:32:15.209952 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.209913    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78mcl\" (UniqueName: \"kubernetes.io/projected/103d0398-33de-44f7-b841-8c74822e8272-kube-api-access-78mcl\") pod \"must-gather-678j9\" (UID: \"103d0398-33de-44f7-b841-8c74822e8272\") " pod="openshift-must-gather-b95cg/must-gather-678j9"
Aug 04 00:32:15.210120 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.209971    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/103d0398-33de-44f7-b841-8c74822e8272-must-gather-output\") pod \"must-gather-678j9\" (UID: \"103d0398-33de-44f7-b841-8c74822e8272\") " pod="openshift-must-gather-b95cg/must-gather-678j9"
Aug 04 00:32:15.210311 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.210293    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/103d0398-33de-44f7-b841-8c74822e8272-must-gather-output\") pod \"must-gather-678j9\" (UID: \"103d0398-33de-44f7-b841-8c74822e8272\") " pod="openshift-must-gather-b95cg/must-gather-678j9"
Aug 04 00:32:15.218771 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.218744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78mcl\" (UniqueName: \"kubernetes.io/projected/103d0398-33de-44f7-b841-8c74822e8272-kube-api-access-78mcl\") pod \"must-gather-678j9\" (UID: \"103d0398-33de-44f7-b841-8c74822e8272\") " pod="openshift-must-gather-b95cg/must-gather-678j9"
Aug 04 00:32:15.305617 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.305534    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b95cg/must-gather-678j9"
Aug 04 00:32:15.442430 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.442382    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b95cg/must-gather-678j9"]
Aug 04 00:32:15.445030 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:32:15.445003    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod103d0398_33de_44f7_b841_8c74822e8272.slice/crio-20c03b7318db49aa7ae8d5fcd3bb2e81dc0098c89f13fc33bc38cffe73006455 WatchSource:0}: Error finding container 20c03b7318db49aa7ae8d5fcd3bb2e81dc0098c89f13fc33bc38cffe73006455: Status 404 returned error can't find the container with id 20c03b7318db49aa7ae8d5fcd3bb2e81dc0098c89f13fc33bc38cffe73006455
Aug 04 00:32:15.446934 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:15.446916    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:32:16.088421 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:16.088385    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b95cg/must-gather-678j9" event={"ID":"103d0398-33de-44f7-b841-8c74822e8272","Type":"ContainerStarted","Data":"20c03b7318db49aa7ae8d5fcd3bb2e81dc0098c89f13fc33bc38cffe73006455"}
Aug 04 00:32:16.463362 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:16.463329    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log" limit=1024
Aug 04 00:32:17.096539 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:17.096504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b95cg/must-gather-678j9" event={"ID":"103d0398-33de-44f7-b841-8c74822e8272","Type":"ContainerStarted","Data":"3034f87e63404b7bfdd7f12188a7d2ae95645598c052ae04f7c4ff7b47a18d1a"}
Aug 04 00:32:17.096934 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:17.096553    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b95cg/must-gather-678j9" event={"ID":"103d0398-33de-44f7-b841-8c74822e8272","Type":"ContainerStarted","Data":"0859d3701b6b2f8ea088d3ca6d3abe044c7bbffe5e20559110db3c564cd879b0"}
Aug 04 00:32:17.117860 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:17.117801    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b95cg/must-gather-678j9" podStartSLOduration=2.13352384 podStartE2EDuration="3.117782241s" totalImagesPullingTime="984.258401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:32:17.116577687 +0000 UTC m=+3738.002906153" watchObservedRunningTime="2026-08-04 00:32:17.117782241 +0000 UTC m=+3738.004110706"
Aug 04 00:32:18.008941 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:18.008911    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8dchf_6ed4e2f3-2b63-42f8-a843-ab87e02ea905/global-pull-secret-syncer/0.log"
Aug 04 00:32:18.138955 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:18.138922    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4glt4_222b3c47-0737-4132-ab88-e8f4d773cbec/konnectivity-agent/0.log"
Aug 04 00:32:18.245337 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:18.245308    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-58.ec2.internal_b5fc83fdf27a40daf0d9c3c0b65f08da/haproxy/0.log"
Aug 04 00:32:23.373483 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:23.373449    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fd9f45b89-bbb62_b76cf502-aaba-43cf-8402-219e07de6521/authorino/0.log"
Aug 04 00:32:23.401995 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:23.401966    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-x26hc_3ea39c69-4ec6-41d5-8244-fabee7f42804/manager/0.log"
Aug 04 00:32:23.430521 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:23.430493    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-j6gkh_2292371f-07b4-4ebc-ac50-5a2b99368697/manager/0.log"
Aug 04 00:32:23.571284 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:23.570505    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-k8hv9_9f17211a-5f8d-45fa-8cbc-e8f87f5d2e18/manager/0.log"
Aug 04 00:32:23.595124 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:23.595091    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-bbwgk_1b0c09eb-99c4-4ea4-9688-db51fc584b42/limitador/0.log"
Aug 04 00:32:25.433769 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:25.433742    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6dc4744f4f-vf6fd_d811728b-f579-4d8b-be5e-b3b59dbf7b67/metrics-server/0.log"
Aug 04 00:32:25.508322 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:25.508299    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rj2h5_e3e6fbf5-951b-459c-9db6-15a7e70014f6/node-exporter/0.log"
Aug 04 00:32:25.527027 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:25.526991    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rj2h5_e3e6fbf5-951b-459c-9db6-15a7e70014f6/kube-rbac-proxy/0.log"
Aug 04 00:32:25.552980 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:25.552958    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rj2h5_e3e6fbf5-951b-459c-9db6-15a7e70014f6/init-textfile/0.log"
Aug 04 00:32:28.353664 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.353628    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"]
Aug 04 00:32:28.358346 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.358324    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.364990 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.364962    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"]
Aug 04 00:32:28.466193 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.466156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxkdn\" (UniqueName: \"kubernetes.io/projected/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-kube-api-access-zxkdn\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.466193 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.466195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-lib-modules\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.466477 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.466278    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-podres\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.466477 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.466320    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-proc\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.466477 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.466358    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-sys\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.567637 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.567588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-podres\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.567823 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.567648    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-proc\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.567823 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.567684    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-sys\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.567823 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.567755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxkdn\" (UniqueName: \"kubernetes.io/projected/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-kube-api-access-zxkdn\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.567823 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.567783    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-lib-modules\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.568029 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.567807    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-proc\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.568029 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.567881    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-sys\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.568029 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.567807    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-podres\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.568029 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.567926    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-lib-modules\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.576396 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.576370    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxkdn\" (UniqueName: \"kubernetes.io/projected/2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b-kube-api-access-zxkdn\") pod \"perf-node-gather-daemonset-fk987\" (UID: \"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b\") " pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.671440 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.671343    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:28.859083 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:28.859000    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"]
Aug 04 00:32:28.861137 ip-10-0-138-58 kubenswrapper[2568]: W0804 00:32:28.861054    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2de02ada_bbdb_45c7_9eeb_04f96ef2bc0b.slice/crio-c41ac1638b09b09c679d928e5fb48bc993eba59ab54bb2216ed249b70ef93f26 WatchSource:0}: Error finding container c41ac1638b09b09c679d928e5fb48bc993eba59ab54bb2216ed249b70ef93f26: Status 404 returned error can't find the container with id c41ac1638b09b09c679d928e5fb48bc993eba59ab54bb2216ed249b70ef93f26
Aug 04 00:32:29.193766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:29.193673    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987" event={"ID":"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b","Type":"ContainerStarted","Data":"2c14a8212bfeb33f6c15839aa186be46dc9fe492c7bd585b607405bec39526fa"}
Aug 04 00:32:29.193766 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:29.193737    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987" event={"ID":"2de02ada-bbdb-45c7-9eeb-04f96ef2bc0b","Type":"ContainerStarted","Data":"c41ac1638b09b09c679d928e5fb48bc993eba59ab54bb2216ed249b70ef93f26"}
Aug 04 00:32:29.193992 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:29.193790    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:29.208924 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:29.208869    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987" podStartSLOduration=1.208853628 podStartE2EDuration="1.208853628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:32:29.208251492 +0000 UTC m=+3750.094579970" watchObservedRunningTime="2026-08-04 00:32:29.208853628 +0000 UTC m=+3750.095182092"
Aug 04 00:32:30.638663 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:30.638630    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nlkm9_9b80e13a-d7dd-4513-8219-c98d1017b80e/dns/0.log"
Aug 04 00:32:30.660065 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:30.660024    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nlkm9_9b80e13a-d7dd-4513-8219-c98d1017b80e/kube-rbac-proxy/0.log"
Aug 04 00:32:30.761358 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:30.761323    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fr6nj_11b51a67-54b6-403b-896b-d9c44784d6eb/dns-node-resolver/0.log"
Aug 04 00:32:31.359666 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:31.359633    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7fc98d7d5d-fbdgg_560bae50-effb-4184-aefe-4af46da04b42/registry/0.log"
Aug 04 00:32:31.405541 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:31.405496    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5jl6_32799c08-ecb0-4c70-accb-1a420eab06d4/node-ca/0.log"
Aug 04 00:32:32.395827 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:32.395790    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c75zgs_af9db11d-b10d-4d77-9e23-66cdbb999ad9/istio-proxy/0.log"
Aug 04 00:32:32.588809 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:32.588777    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd58c6859-c8gpm_23bc3e97-b882-4e74-866a-40c3f2bc9d51/kube-auth-proxy/0.log"
Aug 04 00:32:32.645950 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:32.645868    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mxp6r_097c62e4-1209-4de6-83c5-5b6edf3bc128/istio-proxy/0.log"
Aug 04 00:32:32.655566 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:32.655536    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mxp6r_097c62e4-1209-4de6-83c5-5b6edf3bc128/istio-proxy/1.log"
Aug 04 00:32:33.575160 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:33.575124    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wcx2p_30cb2a44-bdd0-487a-bd70-71ed0c06ecf8/serve-healthcheck-canary/0.log"
Aug 04 00:32:34.143070 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:34.143040    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmqr7_32142187-de54-4fef-82eb-c7b8c9296ff3/kube-rbac-proxy/0.log"
Aug 04 00:32:34.163791 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:34.163767    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmqr7_32142187-de54-4fef-82eb-c7b8c9296ff3/exporter/0.log"
Aug 04 00:32:34.184992 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:34.184958    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmqr7_32142187-de54-4fef-82eb-c7b8c9296ff3/extractor/0.log"
Aug 04 00:32:35.210567 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:35.210418    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b95cg/perf-node-gather-daemonset-fk987"
Aug 04 00:32:36.273000 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:36.272972    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rtpmm_e93b1aba-b926-4e19-992d-bdbd82583c17/manager/0.log"
Aug 04 00:32:36.590955 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:36.590872    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7qfk5_1da8cc91-c2c3-4c57-a474-8029cbd5a735/manager/0.log"
Aug 04 00:32:36.775799 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:36.775771    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nhkdm_14ba5146-56fc-49c2-b642-f7c9e0b70b73/server/0.log"
Aug 04 00:32:36.984794 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:36.984765    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6869c6d9bb-5cbq2_5392f3bc-4613-468d-848c-a0dadf73a3e6/manager/0.log"
Aug 04 00:32:37.008909 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:37.008874    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6869c6d9bb-5cbq2_5392f3bc-4613-468d-848c-a0dadf73a3e6/copy-manifests/0.log"
Aug 04 00:32:38.612903 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:38.612797    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zr7rb_c6d9c9f0-5c86-4d83-870b-8c93b94b87e4/openshift-lws-operator/0.log"
Aug 04 00:32:39.247306 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:39.247233    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c75zgs_af9db11d-b10d-4d77-9e23-66cdbb999ad9/istio-proxy/0.log"
Aug 04 00:32:39.419715 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:39.419679    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd58c6859-c8gpm_23bc3e97-b882-4e74-866a-40c3f2bc9d51/kube-auth-proxy/0.log"
Aug 04 00:32:39.457678 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:39.457647    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mxp6r_097c62e4-1209-4de6-83c5-5b6edf3bc128/istio-proxy/0.log"
Aug 04 00:32:39.468180 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:39.468148    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mxp6r_097c62e4-1209-4de6-83c5-5b6edf3bc128/istio-proxy/1.log"
Aug 04 00:32:40.923486 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:40.923420    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c75zgs_af9db11d-b10d-4d77-9e23-66cdbb999ad9/istio-proxy/0.log"
Aug 04 00:32:41.112904 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:41.112872    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd58c6859-c8gpm_23bc3e97-b882-4e74-866a-40c3f2bc9d51/kube-auth-proxy/0.log"
Aug 04 00:32:41.149983 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:41.149953    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mxp6r_097c62e4-1209-4de6-83c5-5b6edf3bc128/istio-proxy/0.log"
Aug 04 00:32:41.160864 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:41.160833    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mxp6r_097c62e4-1209-4de6-83c5-5b6edf3bc128/istio-proxy/1.log"
Aug 04 00:32:45.014512 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:45.014487    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfhcj_aa302717-cab9-45f2-8638-40c2192c4ac2/kube-multus-additional-cni-plugins/0.log"
Aug 04 00:32:45.034934 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:45.034897    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfhcj_aa302717-cab9-45f2-8638-40c2192c4ac2/egress-router-binary-copy/0.log"
Aug 04 00:32:45.055451 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:45.055424    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfhcj_aa302717-cab9-45f2-8638-40c2192c4ac2/cni-plugins/0.log"
Aug 04 00:32:45.083645 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:45.083614    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfhcj_aa302717-cab9-45f2-8638-40c2192c4ac2/bond-cni-plugin/0.log"
Aug 04 00:32:45.104350 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:45.104323    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfhcj_aa302717-cab9-45f2-8638-40c2192c4ac2/routeoverride-cni/0.log"
Aug 04 00:32:45.125013 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:45.124992    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfhcj_aa302717-cab9-45f2-8638-40c2192c4ac2/whereabouts-cni-bincopy/0.log"
Aug 04 00:32:45.144543 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:45.144511    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfhcj_aa302717-cab9-45f2-8638-40c2192c4ac2/whereabouts-cni/0.log"
Aug 04 00:32:45.328861 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:45.328791    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bnjh9_ce32525a-a080-4032-808a-be6c753b90d6/kube-multus/0.log"
Aug 04 00:32:45.378986 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:45.378943    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bd4gd_1ed5d7d8-00c5-464f-a9ca-ba56adfd186e/network-metrics-daemon/0.log"
Aug 04 00:32:45.397321 ip-10-0-138-58 kubenswrapper[2568]: I0804 00:32:45.397296    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bd4gd_1ed5d7d8-00c5-464f-a9ca-ba56adfd186e/kube-rbac-proxy/0.log"