Sep 08 15:44:30.655861 ip-10-0-143-238 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 15:44:31.011757 ip-10-0-143-238 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:44:31.011757 ip-10-0-143-238 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 15:44:31.011757 ip-10-0-143-238 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:44:31.011757 ip-10-0-143-238 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 15:44:31.011757 ip-10-0-143-238 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:44:31.015187 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.015089    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 15:44:31.018674 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018650    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:44:31.018674 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018671    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:44:31.018674 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018676    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:44:31.018674 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018680    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018685    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018689    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018696    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018700    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018704    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018707    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018711    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018715    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018718    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018722    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018727    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018731    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018735    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018739    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018743    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018747    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018750    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018754    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018758    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:44:31.018937 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018765    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018769    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018783    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018787    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018791    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018795    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018799    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018803    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018807    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018810    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018815    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018819    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018824    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018828    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018833    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018837    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018842    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018846    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018850    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018854    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:44:31.019753 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018859    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018864    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018869    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018873    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018877    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018881    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018885    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018890    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018894    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018898    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018902    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018909    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018917    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018924    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018929    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018933    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018938    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018942    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018946    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:44:31.020606 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018951    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018955    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018959    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018964    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018967    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018973    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018977    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018982    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018987    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018992    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.018996    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019000    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019004    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019013    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019019    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019025    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019030    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019034    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019038    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019042    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:44:31.021334 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019046    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019050    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019055    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019059    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019065    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019069    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019073    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019077    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019081    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019085    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019090    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019095    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019099    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019104    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019108    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019112    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.019116    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020332    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020342    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020348    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:44:31.021849 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020352    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020356    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020361    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020365    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020369    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020374    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020379    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020385    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020393    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020397    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020402    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020406    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020411    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020415    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020420    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020424    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020428    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020432    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020436    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:44:31.022333 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020440    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020444    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020448    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020454    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020458    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020462    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020468    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020472    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020476    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020480    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020486    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020491    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020522    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020527    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020531    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020536    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020543    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020548    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020553    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:44:31.022818 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020557    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020561    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020565    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020570    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020575    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020579    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020583    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020588    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020592    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020596    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020601    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020604    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020608    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020612    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020616    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020620    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020624    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020628    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020632    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020636    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:44:31.023296 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020640    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020645    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020650    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020654    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020659    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020664    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020668    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020672    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020676    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020680    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020684    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020688    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020693    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020699    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020703    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020707    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020712    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020719    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020725    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020730    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:44:31.023801 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020735    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020740    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020744    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020749    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020753    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020757    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020762    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020767    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020771    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020776    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020780    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020784    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020788    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020792    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020797    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020801    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020805    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.020809    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021450    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021463    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:44:31.024299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021467    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021470    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021474    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021477    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021480    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021483    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021486    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021489    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021492    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021495    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021509    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021512    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021516    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021519    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021521    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021524    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021527    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021529    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021532    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021535    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:44:31.024823 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021538    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021540    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021543    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021545    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021548    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021550    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021553    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021556    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021559    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021562    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021565    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021569    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021571    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021574    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021577    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021579    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021582    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021584    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021587    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021590    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:44:31.025306 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021592    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021595    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021598    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021600    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021603    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021605    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021608    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021610    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021613    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021615    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021618    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021620    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021623    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021625    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021628    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021631    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021633    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021637    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021639    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021642    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:44:31.025802 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021644    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021647    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021650    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021654    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021657    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021660    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021663    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021666    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021668    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021671    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021675    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021679    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021684    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021687    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021690    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021693    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021696    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021699    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021702    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:44:31.026338 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021706    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021708    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021711    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021716    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021720    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021723    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021726    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021729    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021732    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021734    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021737    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021740    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021743    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021745    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021749    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021751    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021754    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.021757    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021843    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021880    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 15:44:31.026834 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021888    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021892    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021897    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021900    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021904    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021909    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021915    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021918    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021922    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021926    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021929    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021932    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021934    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021938    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021941    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021944    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021948    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021952    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021955    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021958    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021961    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021965    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021968    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 15:44:31.027306 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021971    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021974    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021977    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021981    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021984    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021987    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021990    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021994    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.021998    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022001    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022004    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022007    2581 flags.go:64] FLAG: --enable-server="true"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022010    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022015    2581 flags.go:64] FLAG: --event-burst="100"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022018    2581 flags.go:64] FLAG: --event-qps="50"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022023    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022026    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022029    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022032    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022035    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022038    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022041    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022044    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022047    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022050    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 15:44:31.027915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022053    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022056    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022059    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022062    2581 flags.go:64] FLAG: --feature-gates=""
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022085    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022089    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022093    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022096    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022100    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022105    2581 flags.go:64] FLAG: --help="false"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022108    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022112    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022115    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022117    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022121    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022124    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022128    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022131    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022134    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022136    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022139    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022142    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022147    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022150    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 15:44:31.028574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022153    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022156    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022158    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022162    2581 flags.go:64] FLAG: --lock-file=""
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022165    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022168    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022171    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022176    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022179    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022182    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022185    2581 flags.go:64] FLAG: --logging-format="text"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022188    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022191    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022193    2581 flags.go:64] FLAG: --manifest-url=""
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022196    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022201    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022204    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022211    2581 flags.go:64] FLAG: --max-pods="110"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022214    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022217    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022220    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022223    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022226    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022229    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022232    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 15:44:31.029172 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022240    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022243    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022247    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022250    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022252    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022260    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022262    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022265    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022269    2581 flags.go:64] FLAG: --port="10250"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022272    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022275    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cd2c697fbdbd9c63"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022278    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022281    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022284    2581 flags.go:64] FLAG: --register-node="true"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022287    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022290    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022294    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022296    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022299    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022303    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022306    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022309    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022312    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022315    2581 flags.go:64] FLAG: --runonce="false"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022318    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 15:44:31.029819 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022322    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022325    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022328    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022331    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022334    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022337    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022341    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022344    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022348    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022351    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022354    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022357    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022361    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022364    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022369    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022372    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022375    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022379    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022382    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022385    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022388    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022391    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022394    2581 flags.go:64] FLAG: --v="2"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022399    2581 flags.go:64] FLAG: --version="false"
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022403    2581 flags.go:64] FLAG: --vmodule=""
Sep 08 15:44:31.030519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022407    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022410    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022546    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022551    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022554    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022558    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022561    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022566    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022569    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022572    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022575    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022577    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022580    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022583    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022585    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022588    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022592    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022594    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022597    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022601    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:44:31.031170 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022603    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022606    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022609    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022611    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022614    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022617    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022619    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022622    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022624    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022627    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022629    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022632    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022634    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022637    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022639    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022642    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022644    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022647    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022649    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022654    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:44:31.031767 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022656    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022659    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022661    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022664    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022667    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022670    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022672    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022675    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022679    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022683    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022686    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022693    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022696    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022699    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022702    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022704    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022707    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022710    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022713    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022716    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:44:31.032243 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022719    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022721    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022724    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022727    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022729    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022732    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022735    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022738    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022740    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022743    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022747    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022752    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022756    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022760    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022763    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022766    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022769    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022771    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022775    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:44:31.032756 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022777    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022780    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022783    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022786    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022790    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022793    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022796    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022798    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022801    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022804    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022806    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022809    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022812    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022814    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022817    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022820    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022823    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022825    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022828    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:44:31.033227 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022831    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022834    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.022836    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.022865    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.030092    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.030117    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.031560    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.031577    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031646    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031652    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031656    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031659    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031662    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031665    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031667    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:44:31.033701 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031670    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031672    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031675    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031678    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031680    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031683    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031686    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031688    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031691    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031695    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031699    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031702    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031705    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031708    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031711    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031713    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031716    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031719    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031721    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:44:31.034088 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031724    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031727    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031729    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031739    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031743    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031746    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031749    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031752    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031754    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031757    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031759    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031762    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031764    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031767    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031770    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031773    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031776    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031778    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031781    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031784    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:44:31.034554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031786    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031789    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031798    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031802    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031806    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031809    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031812    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031815    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031817    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031820    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031823    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031826    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031829    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031831    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031834    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031837    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031846    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031849    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031851    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:44:31.035071 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031856    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031859    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031862    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031865    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031868    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031870    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031873    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031876    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031878    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031881    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031883    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031886    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031889    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031892    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031894    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031897    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031899    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031902    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031904    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031907    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:44:31.035664 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031909    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031912    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031914    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031917    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031920    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031922    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031925    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031927    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031931    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031934    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031942    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031945    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031947    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.031949    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.031955    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032122    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:44:31.036522 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032127    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032130    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032133    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032136    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032139    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032142    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032145    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032148    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032151    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032153    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032156    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032158    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032161    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032163    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032166    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032168    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032171    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032173    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032176    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032180    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:44:31.037109 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032183    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032186    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032188    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032191    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032194    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032197    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032200    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032208    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032211    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032214    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032216    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032219    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032222    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032224    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032227    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032229    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032232    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032234    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032238    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:44:31.037768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032242    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032244    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032248    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032251    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032253    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032256    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032259    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032262    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032264    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032267    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032269    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032272    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032275    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032277    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032280    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032283    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032286    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032288    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032291    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032293    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:44:31.038234 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032296    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032304    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032306    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032309    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032311    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032314    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032316    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032319    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032322    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032324    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032326    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032329    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032332    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032334    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032336    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032339    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032341    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032344    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032347    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032349    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:44:31.038755 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032352    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032354    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032357    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032359    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032362    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032364    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032367    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032369    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032373    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032377    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032380    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032383    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032385    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032388    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032396    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032399    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032402    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032405    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:44:31.039258 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:31.032408    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:44:31.039934 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.032412    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:44:31.039934 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.032591    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 15:44:31.039934 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.038606    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 15:44:31.039934 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.039488    2581 server.go:1019] "Starting client certificate rotation"
Sep 08 15:44:31.039934 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.039607    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 15:44:31.039934 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.039666    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 15:44:31.041801 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.041783    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 15:44:31.045334 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.045311    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 15:44:31.055044 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.055021    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 08 15:44:31.060794 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.060774    2581 log.go:25] "Validated CRI v1 image API"
Sep 08 15:44:31.061898 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.061877    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 15:44:31.067355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.067335    2581 fs.go:135] Filesystem UUIDs: map[51875d65-8f10-4ae5-a12b-eed3c6fd2b70:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9d15af70-c1f3-4f69-bde9-774a6c63b801:/dev/nvme0n1p4]
Sep 08 15:44:31.067429 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.067354    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 15:44:31.073200 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.073072    2581 manager.go:216] Machine: {Timestamp:2026-09-08 15:44:31.071903025 +0000 UTC m=+0.312380661 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100067 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2908e59c82bca979dab70fddd543d1 SystemUUID:ec2908e5-9c82-bca9-79da-b70fddd543d1 BootID:9647e08f-c06c-4404-9c83-269a6ae0b945 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fc:1d:d7:71:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fc:1d:d7:71:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:25:41:41:fc:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 15:44:31.073200 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.073188    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 15:44:31.073379 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.073286    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 15:44:31.076179 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.076142    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 15:44:31.076336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.076180    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 15:44:31.076590 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.076572    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 15:44:31.076898 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.076879    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 15:44:31.076942 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.076904    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 15:44:31.076942 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.076913    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 15:44:31.077477 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.077465    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 15:44:31.078708 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.078697    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 15:44:31.082442 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.082428    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 15:44:31.082599 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.082588    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 15:44:31.082655 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.082631    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 15:44:31.082655 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.082652    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 15:44:31.082733 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.082672    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 15:44:31.082733 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.082687    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 08 15:44:31.082733 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.082698    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 15:44:31.083443 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.083428    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 15:44:31.083524 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.083455    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 15:44:31.086917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.086884    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 15:44:31.089234 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.089216    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 15:44:31.089324 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.089254    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 15:44:31.090149 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090135    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 15:44:31.090221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090160    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 15:44:31.090221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090169    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 15:44:31.090221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090176    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 15:44:31.090221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090189    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 15:44:31.090221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090198    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 15:44:31.090221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090218    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 15:44:31.090426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090226    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 15:44:31.090426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090237    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 15:44:31.090426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090246    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 15:44:31.090426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090259    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 15:44:31.090426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090268    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 15:44:31.090933 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090921    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 15:44:31.090997 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.090936    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 15:44:31.093385 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.093354    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 15:44:31.093523 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.093432    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 15:44:31.093733 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.093705    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 15:44:31.094917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.094894    2581 server.go:1268] "Started kubelet"
Sep 08 15:44:31.095016 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.094966    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 15:44:31.095128 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.095050    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 15:44:31.095183 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.095129    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 15:44:31.096019 ip-10-0-143-238 systemd[1]: Started Kubernetes Kubelet.
Sep 08 15:44:31.096918 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.096694    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 15:44:31.096918 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.096895    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 15:44:31.099488 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.099468    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 15:44:31.101390 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.101369    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 15:44:31.101390 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.101385    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 15:44:31.101618 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.101436    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:31.101677 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.099636    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-238.ec2.internal.18d362f2999a816c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-238.ec2.internal,UID:ip-10-0-143-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-238.ec2.internal,},FirstTimestamp:2026-09-08 15:44:31.094866284 +0000 UTC m=+0.335343918,LastTimestamp:2026-09-08 15:44:31.094866284 +0000 UTC m=+0.335343918,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-238.ec2.internal,}"
Sep 08 15:44:31.102423 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.102401    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 15:44:31.102423 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.102418    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 15:44:31.102588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.102533    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 15:44:31.102588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.102541    2581 factory.go:55] Registering systemd factory
Sep 08 15:44:31.102588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.102550    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 15:44:31.102588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.102559    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 15:44:31.102761 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.102560    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 08 15:44:31.102946 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.102901    2581 factory.go:153] Registering CRI-O factory
Sep 08 15:44:31.102946 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.102918    2581 factory.go:223] Registration of the crio container factory successfully
Sep 08 15:44:31.103043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.102991    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 15:44:31.103043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.103010    2581 factory.go:103] Registering Raw factory
Sep 08 15:44:31.103043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.103025    2581 manager.go:1196] Started watching for new ooms in manager
Sep 08 15:44:31.103456 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.103442    2581 manager.go:349] Starting recovery of all containers
Sep 08 15:44:31.111853 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.106333    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dlmmn"
Sep 08 15:44:31.113321 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.113103    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 15:44:31.113538 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.113476    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 15:44:31.115927 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.115306    2581 manager.go:354] Recovery completed
Sep 08 15:44:31.115927 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.115407    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dlmmn"
Sep 08 15:44:31.118305 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.118285    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 08 15:44:31.121651 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.121638    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:44:31.123743 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.123720    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:44:31.123848 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.123758    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:44:31.123848 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.123773    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:44:31.124361 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.124339    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 15:44:31.124361 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.124354    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:44:31.124361 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.124361    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 15:44:31.124567 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.124381    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 15:44:31.126066 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.126050    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:44:31.126129 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.126078    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:44:31.126129 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.126089    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:44:31.126631 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.126620    2581 policy_none.go:49] "None policy: Start"
Sep 08 15:44:31.126682 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.126634    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 15:44:31.126682 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.126644    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 15:44:31.128704 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.128691    2581 policy_none.go:47] "Start"
Sep 08 15:44:31.202342 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.202295    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:31.239396 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.239359    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 15:44:31.240569 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.240542    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 15:44:31.240699 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.240616    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 15:44:31.240699 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.240648    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 15:44:31.240801 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.240762    2581 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 08 15:44:31.242191 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.242168    2581 manager.go:337] "Starting Device Plugin manager"
Sep 08 15:44:31.242294 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.242213    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 15:44:31.242294 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.242225    2581 server.go:87] "Starting device plugin registration server"
Sep 08 15:44:31.242648 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.242633    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 15:44:31.242725 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.242648    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 15:44:31.243041 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.242836    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 15:44:31.243195 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.243177    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 15:44:31.243195 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.243194    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 15:44:31.243478 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.243460    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:44:31.243749 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.243711    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 15:44:31.243828 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.243765    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:31.319139 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.319102    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-238.ec2.internal\" not found" node="ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.341273 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.341210    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal"]
Sep 08 15:44:31.341370 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.341324    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:44:31.343550 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.343534    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:44:31.344408 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.344378    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:44:31.344548 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.344424    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:44:31.344548 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.344440    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:44:31.344548 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.344465    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.344709 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.344664    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:44:31.344709 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.344691    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:44:31.344709 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.344701    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:44:31.347005 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.346992    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:44:31.347141 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.347125    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.347202 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.347162    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:44:31.348779 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.348544    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:44:31.348779 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.348572    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:44:31.348779 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.348585    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:44:31.349102 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.349082    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:44:31.349237 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.349116    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:44:31.349237 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.349129    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:44:31.350791 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.350774    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.350874 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.350813    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:44:31.352602 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.352578    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:44:31.352685 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.352618    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:44:31.352685 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.352634    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:44:31.353675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.353661    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.353756 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.353686    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-238.ec2.internal\": node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:31.368324 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.368294    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:31.376417 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.376392    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-238.ec2.internal\" not found" node="ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.380924 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.380905    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-238.ec2.internal\" not found" node="ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.404434 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.404403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/386588c28009e12e1e0236c3f6df40f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal\" (UID: \"386588c28009e12e1e0236c3f6df40f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.404434 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.404434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386588c28009e12e1e0236c3f6df40f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal\" (UID: \"386588c28009e12e1e0236c3f6df40f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.404617 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.404452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acc58ec07b60ea490ac16da8d8db6186-config\") pod \"kube-apiserver-proxy-ip-10-0-143-238.ec2.internal\" (UID: \"acc58ec07b60ea490ac16da8d8db6186\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.469194 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.469164    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:31.505038 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.504997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/386588c28009e12e1e0236c3f6df40f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal\" (UID: \"386588c28009e12e1e0236c3f6df40f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.505216 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.505044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386588c28009e12e1e0236c3f6df40f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal\" (UID: \"386588c28009e12e1e0236c3f6df40f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.505216 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.505085    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acc58ec07b60ea490ac16da8d8db6186-config\") pod \"kube-apiserver-proxy-ip-10-0-143-238.ec2.internal\" (UID: \"acc58ec07b60ea490ac16da8d8db6186\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.505216 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.505100    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/386588c28009e12e1e0236c3f6df40f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal\" (UID: \"386588c28009e12e1e0236c3f6df40f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.505216 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.505180    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386588c28009e12e1e0236c3f6df40f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal\" (UID: \"386588c28009e12e1e0236c3f6df40f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.505216 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.505192    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acc58ec07b60ea490ac16da8d8db6186-config\") pod \"kube-apiserver-proxy-ip-10-0-143-238.ec2.internal\" (UID: \"acc58ec07b60ea490ac16da8d8db6186\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.570039 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.569936    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:31.670720 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.670683    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:31.678857 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.678827    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.683785 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:31.683633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:31.771715 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.771672    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:31.872347 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.872268    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:31.972930 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:31.972882    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:32.040523 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.040472    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 15:44:32.040993 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.040662    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 15:44:32.073816 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:32.073770    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:32.118514 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.118462    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 15:39:32 +0000 UTC" deadline="2028-05-09 10:34:20.449615861 +0000 UTC"
Sep 08 15:44:32.118514 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.118509    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14610h49m48.331122566s"
Sep 08 15:44:32.174726 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:32.174628    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:32.275403 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:32.275360    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-238.ec2.internal\" not found"
Sep 08 15:44:32.366629 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.366596    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:44:32.401659 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.401630    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:32.401838 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.401797    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:44:32.411028 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.411006    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 15:44:32.412606 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.412588    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal"
Sep 08 15:44:32.421367 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.421344    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 15:44:32.480795 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:32.480765    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386588c28009e12e1e0236c3f6df40f3.slice/crio-e45b8524e34a6918930a59d91ccde22e5bd9d8a1fa5c4b1e4e48f3990f28173b WatchSource:0}: Error finding container e45b8524e34a6918930a59d91ccde22e5bd9d8a1fa5c4b1e4e48f3990f28173b: Status 404 returned error can't find the container with id e45b8524e34a6918930a59d91ccde22e5bd9d8a1fa5c4b1e4e48f3990f28173b
Sep 08 15:44:32.485763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.485745    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:44:32.579136 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:32.579106    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:44:33.083847 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.083816    2581 apiserver.go:52] "Watching apiserver"
Sep 08 15:44:33.092647 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.092615    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 15:44:33.093022 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.092994    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-zfd8g","openshift-network-operator/iptables-alerter-ns5fg","openshift-ovn-kubernetes/ovnkube-node-nt496","kube-system/global-pull-secret-syncer-q5jph","kube-system/konnectivity-agent-gr864","kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2nssl","openshift-image-registry/node-ca-vnv7m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal","openshift-multus/multus-rsff8","openshift-multus/network-metrics-daemon-tk7z8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs","openshift-dns/node-resolver-8mfgw","openshift-multus/multus-additional-cni-plugins-b47kh"]
Sep 08 15:44:33.095581 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.095559    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.097719 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.097694    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m4x2n\""
Sep 08 15:44:33.097719 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.097709    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:44:33.097907 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.097714    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 15:44:33.097907 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.097845    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.099725 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.099702    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 15:44:33.099849 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.099809    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qq84x\""
Sep 08 15:44:33.099849 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.099824    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 15:44:33.100243 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.100225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.102143 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.102124    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 15:44:33.102246 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.102130    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 15:44:33.102323 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.102306    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 15:44:33.102791 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.102658    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 15:44:33.102791 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.102669    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 15:44:33.102791 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.102674    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wl4zn\""
Sep 08 15:44:33.102791 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.102683    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 15:44:33.103028 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.102907    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 15:44:33.103028 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.102909    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:33.103124 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.103075    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:33.105266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.105248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:33.107461 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.107439    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 15:44:33.107601 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.107439    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 15:44:33.107601 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.107532    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-984vf\""
Sep 08 15:44:33.107728 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.107708    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.109779 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.109717    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 15:44:33.109779 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.109775    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 15:44:33.109999 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.109775    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 15:44:33.109999 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.109916    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 15:44:33.109999 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.109918    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 15:44:33.110165 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.110137    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.110384 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.110154    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5n4jk\""
Sep 08 15:44:33.110784 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.110767    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 15:44:33.112787 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.112099    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 15:44:33.112787 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.112146    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jq578\""
Sep 08 15:44:33.112787 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.112287    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 15:44:33.112787 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.112325    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 15:44:33.113323 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.113306    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:33.113404 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.113368    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:33.114691 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:33.114784 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsh68\" (UniqueName: \"kubernetes.io/projected/6e5777e7-673f-433b-8801-c987cdb4b1b8-kube-api-access-jsh68\") pod \"node-resolver-8mfgw\" (UID: \"6e5777e7-673f-433b-8801-c987cdb4b1b8\") " pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.114784 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114731    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-var-lib-openvswitch\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.114784 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-etc-openvswitch\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.114784 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-run-ovn\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.114961 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-node-log\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.114961 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-cni-netd\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.114961 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf33e832-454f-4983-828c-059875e55c08-env-overrides\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.114961 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-sysconfig\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.114961 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-tmp\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.114961 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114894    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpdwf\" (UniqueName: \"kubernetes.io/projected/bf33e832-454f-4983-828c-059875e55c08-kube-api-access-xpdwf\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.114961 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec19266e-6f33-48f8-a4fd-f09a750a0e57-kubelet-config\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:33.114961 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-modprobe-d\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.114986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-log-socket\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf33e832-454f-4983-828c-059875e55c08-ovn-node-metrics-cert\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-slash\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94657cce-2a40-4616-a505-beb24b11159d-konnectivity-ca\") pod \"konnectivity-agent-gr864\" (UID: \"94657cce-2a40-4616-a505-beb24b11159d\") " pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-kubernetes\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e5777e7-673f-433b-8801-c987cdb4b1b8-tmp-dir\") pod \"node-resolver-8mfgw\" (UID: \"6e5777e7-673f-433b-8801-c987cdb4b1b8\") " pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-run-openvswitch\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-sysctl-conf\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e5777e7-673f-433b-8801-c987cdb4b1b8-hosts-file\") pod \"node-resolver-8mfgw\" (UID: \"6e5777e7-673f-433b-8801-c987cdb4b1b8\") " pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-systemd-units\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115290    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-run-netns\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf33e832-454f-4983-828c-059875e55c08-ovnkube-script-lib\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec19266e-6f33-48f8-a4fd-f09a750a0e57-dbus\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-host\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-tuned\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-run-systemd\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-cni-bin\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115470    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115513    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-lib-modules\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-kubelet\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115565    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-run-ovn-kubernetes\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94657cce-2a40-4616-a505-beb24b11159d-agent-certs\") pod \"konnectivity-agent-gr864\" (UID: \"94657cce-2a40-4616-a505-beb24b11159d\") " pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-sysctl-d\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-systemd\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-run\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-sys\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-var-lib-kubelet\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lq9m\" (UniqueName: \"kubernetes.io/projected/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-kube-api-access-2lq9m\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.115905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.116560 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.115845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf33e832-454f-4983-828c-059875e55c08-ovnkube-config\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.117577 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.117555    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:44:33.117797 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.117781    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 15:44:33.117900 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.117885    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 15:44:33.117960 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.117905    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6xjrr\""
Sep 08 15:44:33.118704 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.118405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.120155 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.120123    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 15:44:33.120260 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.120215    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zxh9j\""
Sep 08 15:44:33.120940 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.120921    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:33.121031 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.121006    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:33.125036 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.124572    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.126777 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.126750    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 15:44:33.127289 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.127267    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2p5x4\""
Sep 08 15:44:33.127485 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.127467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 15:44:33.127580 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.127559    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 15:44:33.132901 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.132876    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c7dcf"
Sep 08 15:44:33.140648 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.140520    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c7dcf"
Sep 08 15:44:33.204372 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.204337    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 15:44:33.216417 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-modprobe-d\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.216417 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-log-socket\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.216675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80d28796-7d3c-4876-b0e8-acfc6c4eef23-iptables-alerter-script\") pod \"iptables-alerter-ns5fg\" (UID: \"80d28796-7d3c-4876-b0e8-acfc6c4eef23\") " pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.216675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-cnibin\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.216675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-slash\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.216675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216571    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-log-socket\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.216675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-modprobe-d\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.216675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94657cce-2a40-4616-a505-beb24b11159d-konnectivity-ca\") pod \"konnectivity-agent-gr864\" (UID: \"94657cce-2a40-4616-a505-beb24b11159d\") " pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:33.216675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-run-openvswitch\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.216675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-slash\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.216675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216677    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-run-openvswitch\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.216675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216710    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c25kf\" (UniqueName: \"kubernetes.io/projected/58f3e0d6-9b77-4370-b753-d9fe5fe6769d-kube-api-access-c25kf\") pod \"node-ca-vnv7m\" (UID: \"58f3e0d6-9b77-4370-b753-d9fe5fe6769d\") " pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-system-cni-dir\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-var-lib-kubelet\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e5777e7-673f-433b-8801-c987cdb4b1b8-hosts-file\") pod \"node-resolver-8mfgw\" (UID: \"6e5777e7-673f-433b-8801-c987cdb4b1b8\") " pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-run-k8s-cni-cncf-io\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-run-netns\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-socket-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-registration-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e5777e7-673f-433b-8801-c987cdb4b1b8-hosts-file\") pod \"node-resolver-8mfgw\" (UID: \"6e5777e7-673f-433b-8801-c987cdb4b1b8\") " pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-device-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec19266e-6f33-48f8-a4fd-f09a750a0e57-dbus\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-host\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-run-systemd\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.216998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-cni-bin\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec19266e-6f33-48f8-a4fd-f09a750a0e57-dbus\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217025    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-run-systemd\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.217186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-cni-bin\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-cni-binary-copy\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217049    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-host\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217102    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58f3e0d6-9b77-4370-b753-d9fe5fe6769d-serviceca\") pod \"node-ca-vnv7m\" (UID: \"58f3e0d6-9b77-4370-b753-d9fe5fe6769d\") " pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-kubelet\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-run-ovn-kubernetes\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94657cce-2a40-4616-a505-beb24b11159d-konnectivity-ca\") pod \"konnectivity-agent-gr864\" (UID: \"94657cce-2a40-4616-a505-beb24b11159d\") " pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbfqk\" (UniqueName: \"kubernetes.io/projected/80d28796-7d3c-4876-b0e8-acfc6c4eef23-kube-api-access-bbfqk\") pod \"iptables-alerter-ns5fg\" (UID: \"80d28796-7d3c-4876-b0e8-acfc6c4eef23\") " pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217209    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-kubelet\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-var-lib-cni-bin\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-run-ovn-kubernetes\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhb84\" (UniqueName: \"kubernetes.io/projected/f4d487fe-c0f8-427a-8ed1-66d412972925-kube-api-access-hhb84\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-run\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-sys\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.217917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217410    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-sys\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-run\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-var-lib-kubelet\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lq9m\" (UniqueName: \"kubernetes.io/projected/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-kube-api-access-2lq9m\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-var-lib-kubelet\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf33e832-454f-4983-828c-059875e55c08-ovnkube-config\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-cnibin\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-socket-dir-parent\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsh68\" (UniqueName: \"kubernetes.io/projected/6e5777e7-673f-433b-8801-c987cdb4b1b8-kube-api-access-jsh68\") pod \"node-resolver-8mfgw\" (UID: \"6e5777e7-673f-433b-8801-c987cdb4b1b8\") " pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-var-lib-openvswitch\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-run-ovn\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-node-log\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-cni-netd\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpjs8\" (UniqueName: \"kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8\") pod \"network-check-target-zfd8g\" (UID: \"8b206d20-85f6-4f51-a10c-dff318621c06\") " pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-sysconfig\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-node-log\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdwf\" (UniqueName: \"kubernetes.io/projected/bf33e832-454f-4983-828c-059875e55c08-kube-api-access-xpdwf\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.218604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58f3e0d6-9b77-4370-b753-d9fe5fe6769d-host\") pod \"node-ca-vnv7m\" (UID: \"58f3e0d6-9b77-4370-b753-d9fe5fe6769d\") " pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-conf-dir\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-var-lib-openvswitch\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec19266e-6f33-48f8-a4fd-f09a750a0e57-kubelet-config\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf33e832-454f-4983-828c-059875e55c08-ovn-node-metrics-cert\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-run-multus-certs\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpnsp\" (UniqueName: \"kubernetes.io/projected/b2adb38c-9df2-48ea-9589-da7313708ae6-kube-api-access-gpnsp\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-run-ovn\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-kubernetes\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e5777e7-673f-433b-8801-c987cdb4b1b8-tmp-dir\") pod \"node-resolver-8mfgw\" (UID: \"6e5777e7-673f-433b-8801-c987cdb4b1b8\") " pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-cni-netd\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80d28796-7d3c-4876-b0e8-acfc6c4eef23-host-slash\") pod \"iptables-alerter-ns5fg\" (UID: \"80d28796-7d3c-4876-b0e8-acfc6c4eef23\") " pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-hostroot\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-sysctl-conf\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-systemd-units\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-run-netns\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf33e832-454f-4983-828c-059875e55c08-ovnkube-script-lib\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.219336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4d487fe-c0f8-427a-8ed1-66d412972925-cni-binary-copy\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.217934    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf33e832-454f-4983-828c-059875e55c08-ovnkube-config\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-tuned\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bt8t\" (UniqueName: \"kubernetes.io/projected/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-kube-api-access-7bt8t\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218194    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-kubernetes\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec19266e-6f33-48f8-a4fd-f09a750a0e57-kubelet-config\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218196    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-sysconfig\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-etc-selinux\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-sysctl-conf\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-host-run-netns\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-lib-modules\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218352    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-systemd-units\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218433    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-daemon-config\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94657cce-2a40-4616-a505-beb24b11159d-agent-certs\") pod \"konnectivity-agent-gr864\" (UID: \"94657cce-2a40-4616-a505-beb24b11159d\") " pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-lib-modules\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.220026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218485    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e5777e7-673f-433b-8801-c987cdb4b1b8-tmp-dir\") pod \"node-resolver-8mfgw\" (UID: \"6e5777e7-673f-433b-8801-c987cdb4b1b8\") " pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-sysctl-d\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-systemd\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218712    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-var-lib-cni-multus\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7nhc\" (UniqueName: \"kubernetes.io/projected/7f248c91-519f-4278-a822-ed12fcee59d0-kube-api-access-z7nhc\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-sys-fs\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218759    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-sysctl-d\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf33e832-454f-4983-828c-059875e55c08-ovnkube-script-lib\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218799    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-systemd\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-etc-openvswitch\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218821    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf33e832-454f-4983-828c-059875e55c08-env-overrides\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf33e832-454f-4983-828c-059875e55c08-etc-openvswitch\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.218880    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-system-cni-dir\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-cni-dir\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.220763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.218983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-etc-kubernetes\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.221621 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.219011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-tmp\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.221621 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.219183    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret podName:ec19266e-6f33-48f8-a4fd-f09a750a0e57 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:33.71914185 +0000 UTC m=+2.959619488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret") pod "global-pull-secret-syncer-q5jph" (UID: "ec19266e-6f33-48f8-a4fd-f09a750a0e57") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:33.221621 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.219240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf33e832-454f-4983-828c-059875e55c08-env-overrides\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.223006 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.222974    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-tmp\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.223006 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.223000    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-etc-tuned\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.223260 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.223035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf33e832-454f-4983-828c-059875e55c08-ovn-node-metrics-cert\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.223573 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.223553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94657cce-2a40-4616-a505-beb24b11159d-agent-certs\") pod \"konnectivity-agent-gr864\" (UID: \"94657cce-2a40-4616-a505-beb24b11159d\") " pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:33.231756 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.231726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsh68\" (UniqueName: \"kubernetes.io/projected/6e5777e7-673f-433b-8801-c987cdb4b1b8-kube-api-access-jsh68\") pod \"node-resolver-8mfgw\" (UID: \"6e5777e7-673f-433b-8801-c987cdb4b1b8\") " pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.232252 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.232230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lq9m\" (UniqueName: \"kubernetes.io/projected/c699be0a-a30b-4a97-a4f4-07ff2af26e1f-kube-api-access-2lq9m\") pod \"tuned-2nssl\" (UID: \"c699be0a-a30b-4a97-a4f4-07ff2af26e1f\") " pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.232455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.232436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpdwf\" (UniqueName: \"kubernetes.io/projected/bf33e832-454f-4983-828c-059875e55c08-kube-api-access-xpdwf\") pod \"ovnkube-node-nt496\" (UID: \"bf33e832-454f-4983-828c-059875e55c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.245705 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.245651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal" event={"ID":"386588c28009e12e1e0236c3f6df40f3","Type":"ContainerStarted","Data":"e45b8524e34a6918930a59d91ccde22e5bd9d8a1fa5c4b1e4e48f3990f28173b"}
Sep 08 15:44:33.319608 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-cni-binary-copy\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.319608 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58f3e0d6-9b77-4370-b753-d9fe5fe6769d-serviceca\") pod \"node-ca-vnv7m\" (UID: \"58f3e0d6-9b77-4370-b753-d9fe5fe6769d\") " pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbfqk\" (UniqueName: \"kubernetes.io/projected/80d28796-7d3c-4876-b0e8-acfc6c4eef23-kube-api-access-bbfqk\") pod \"iptables-alerter-ns5fg\" (UID: \"80d28796-7d3c-4876-b0e8-acfc6c4eef23\") " pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-var-lib-cni-bin\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhb84\" (UniqueName: \"kubernetes.io/projected/f4d487fe-c0f8-427a-8ed1-66d412972925-kube-api-access-hhb84\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319711    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-cnibin\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-socket-dir-parent\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319734    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-var-lib-cni-bin\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjs8\" (UniqueName: \"kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8\") pod \"network-check-target-zfd8g\" (UID: \"8b206d20-85f6-4f51-a10c-dff318621c06\") " pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58f3e0d6-9b77-4370-b753-d9fe5fe6769d-host\") pod \"node-ca-vnv7m\" (UID: \"58f3e0d6-9b77-4370-b753-d9fe5fe6769d\") " pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-cnibin\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319823    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58f3e0d6-9b77-4370-b753-d9fe5fe6769d-host\") pod \"node-ca-vnv7m\" (UID: \"58f3e0d6-9b77-4370-b753-d9fe5fe6769d\") " pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-conf-dir\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.319850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319857    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-socket-dir-parent\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-run-multus-certs\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpnsp\" (UniqueName: \"kubernetes.io/projected/b2adb38c-9df2-48ea-9589-da7313708ae6-kube-api-access-gpnsp\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-conf-dir\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80d28796-7d3c-4876-b0e8-acfc6c4eef23-host-slash\") pod \"iptables-alerter-ns5fg\" (UID: \"80d28796-7d3c-4876-b0e8-acfc6c4eef23\") " pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-run-multus-certs\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-hostroot\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319965    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80d28796-7d3c-4876-b0e8-acfc6c4eef23-host-slash\") pod \"iptables-alerter-ns5fg\" (UID: \"80d28796-7d3c-4876-b0e8-acfc6c4eef23\") " pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319981    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-hostroot\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.319981    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4d487fe-c0f8-427a-8ed1-66d412972925-cni-binary-copy\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bt8t\" (UniqueName: \"kubernetes.io/projected/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-kube-api-access-7bt8t\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-etc-selinux\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-daemon-config\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-var-lib-cni-multus\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58f3e0d6-9b77-4370-b753-d9fe5fe6769d-serviceca\") pod \"node-ca-vnv7m\" (UID: \"58f3e0d6-9b77-4370-b753-d9fe5fe6769d\") " pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7nhc\" (UniqueName: \"kubernetes.io/projected/7f248c91-519f-4278-a822-ed12fcee59d0-kube-api-access-z7nhc\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:33.320455 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.320175    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320258    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-etc-selinux\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320280    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-cni-binary-copy\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.320307    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs podName:7f248c91-519f-4278-a822-ed12fcee59d0 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:33.820287925 +0000 UTC m=+3.060765551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs") pod "network-metrics-daemon-tk7z8" (UID: "7f248c91-519f-4278-a822-ed12fcee59d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-var-lib-cni-multus\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-sys-fs\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-system-cni-dir\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-sys-fs\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-system-cni-dir\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4d487fe-c0f8-427a-8ed1-66d412972925-cni-binary-copy\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-cni-dir\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-etc-kubernetes\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80d28796-7d3c-4876-b0e8-acfc6c4eef23-iptables-alerter-script\") pod \"iptables-alerter-ns5fg\" (UID: \"80d28796-7d3c-4876-b0e8-acfc6c4eef23\") " pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-cnibin\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320656    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-cni-dir\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c25kf\" (UniqueName: \"kubernetes.io/projected/58f3e0d6-9b77-4370-b753-d9fe5fe6769d-kube-api-access-c25kf\") pod \"node-ca-vnv7m\" (UID: \"58f3e0d6-9b77-4370-b753-d9fe5fe6769d\") " pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320710    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-cnibin\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320720    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-etc-kubernetes\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-system-cni-dir\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320819    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f4d487fe-c0f8-427a-8ed1-66d412972925-multus-daemon-config\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-system-cni-dir\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320929    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-var-lib-kubelet\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.320988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-run-k8s-cni-cncf-io\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321011    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-var-lib-kubelet\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-run-netns\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321040    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-socket-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-run-k8s-cni-cncf-io\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321051    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4d487fe-c0f8-427a-8ed1-66d412972925-host-run-netns\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.321718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-registration-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.322175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80d28796-7d3c-4876-b0e8-acfc6c4eef23-iptables-alerter-script\") pod \"iptables-alerter-ns5fg\" (UID: \"80d28796-7d3c-4876-b0e8-acfc6c4eef23\") " pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.322175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-device-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.322175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-device-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.322175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321115    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-socket-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.322175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.321158    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b2adb38c-9df2-48ea-9589-da7313708ae6-registration-dir\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.328675 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.328644    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:44:33.328675 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.328676    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:44:33.328878 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.328689    2581 projected.go:196] Error preparing data for projected volume kube-api-access-lpjs8 for pod openshift-network-diagnostics/network-check-target-zfd8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:33.328878 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:33.328757    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8 podName:8b206d20-85f6-4f51-a10c-dff318621c06 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:33.82874052 +0000 UTC m=+3.069218156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lpjs8" (UniqueName: "kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8") pod "network-check-target-zfd8g" (UID: "8b206d20-85f6-4f51-a10c-dff318621c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:33.330565 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.330536    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpnsp\" (UniqueName: \"kubernetes.io/projected/b2adb38c-9df2-48ea-9589-da7313708ae6-kube-api-access-gpnsp\") pod \"aws-ebs-csi-driver-node-gjjfs\" (UID: \"b2adb38c-9df2-48ea-9589-da7313708ae6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:33.330687 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.330658    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bt8t\" (UniqueName: \"kubernetes.io/projected/d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7-kube-api-access-7bt8t\") pod \"multus-additional-cni-plugins-b47kh\" (UID: \"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7\") " pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.330845 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.330825    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhb84\" (UniqueName: \"kubernetes.io/projected/f4d487fe-c0f8-427a-8ed1-66d412972925-kube-api-access-hhb84\") pod \"multus-rsff8\" (UID: \"f4d487fe-c0f8-427a-8ed1-66d412972925\") " pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.335933 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.335869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbfqk\" (UniqueName: \"kubernetes.io/projected/80d28796-7d3c-4876-b0e8-acfc6c4eef23-kube-api-access-bbfqk\") pod \"iptables-alerter-ns5fg\" (UID: \"80d28796-7d3c-4876-b0e8-acfc6c4eef23\") " pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.336037 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.335934    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c25kf\" (UniqueName: \"kubernetes.io/projected/58f3e0d6-9b77-4370-b753-d9fe5fe6769d-kube-api-access-c25kf\") pod \"node-ca-vnv7m\" (UID: \"58f3e0d6-9b77-4370-b753-d9fe5fe6769d\") " pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.336037 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.335945    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7nhc\" (UniqueName: \"kubernetes.io/projected/7f248c91-519f-4278-a822-ed12fcee59d0-kube-api-access-z7nhc\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:33.407204 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.407167    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2nssl"
Sep 08 15:44:33.417320 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.417287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8mfgw"
Sep 08 15:44:33.424178 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.424148    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:44:33.430532 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.430491    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:33.437310 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.437273    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b47kh"
Sep 08 15:44:33.444126 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.444101    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vnv7m"
Sep 08 15:44:33.451847 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.451824    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ns5fg"
Sep 08 15:44:33.459596 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.459569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rsff8"
Sep 08 15:44:33.465545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:33.465521    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs"
Sep 08 15:44:34.718513 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:34.718443    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:44:34.826080 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:34.825837    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc699be0a_a30b_4a97_a4f4_07ff2af26e1f.slice/crio-0cd9270d8cf42883f077befda3c2f28ef46a5736112170162412586a1cef548b WatchSource:0}: Error finding container 0cd9270d8cf42883f077befda3c2f28ef46a5736112170162412586a1cef548b: Status 404 returned error can't find the container with id 0cd9270d8cf42883f077befda3c2f28ef46a5736112170162412586a1cef548b
Sep 08 15:44:34.828115 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:34.828094    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d28796_7d3c_4876_b0e8_acfc6c4eef23.slice/crio-4f21f53fa378700d5e6f093f77b6be771ca7cbe61c98e10915468ec1b6dfa290 WatchSource:0}: Error finding container 4f21f53fa378700d5e6f093f77b6be771ca7cbe61c98e10915468ec1b6dfa290: Status 404 returned error can't find the container with id 4f21f53fa378700d5e6f093f77b6be771ca7cbe61c98e10915468ec1b6dfa290
Sep 08 15:44:34.831555 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:34.831524    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f3e0d6_9b77_4370_b753_d9fe5fe6769d.slice/crio-829d04c8d481d3e79d1a7adb2c9939c07b215e69cec859bec16a2ad70b1f03be WatchSource:0}: Error finding container 829d04c8d481d3e79d1a7adb2c9939c07b215e69cec859bec16a2ad70b1f03be: Status 404 returned error can't find the container with id 829d04c8d481d3e79d1a7adb2c9939c07b215e69cec859bec16a2ad70b1f03be
Sep 08 15:44:34.832554 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:34.832531    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94657cce_2a40_4616_a505_beb24b11159d.slice/crio-58bdfea371e86177ffdcf74be8601ac04bdffbcc5b4781dfb857e495fb47cff7 WatchSource:0}: Error finding container 58bdfea371e86177ffdcf74be8601ac04bdffbcc5b4781dfb857e495fb47cff7: Status 404 returned error can't find the container with id 58bdfea371e86177ffdcf74be8601ac04bdffbcc5b4781dfb857e495fb47cff7
Sep 08 15:44:34.833349 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:34.833329    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2adb38c_9df2_48ea_9589_da7313708ae6.slice/crio-7ab097c9b28b80aa3ee702f13b57b1cc022968655bff90b6fe9076a17103a615 WatchSource:0}: Error finding container 7ab097c9b28b80aa3ee702f13b57b1cc022968655bff90b6fe9076a17103a615: Status 404 returned error can't find the container with id 7ab097c9b28b80aa3ee702f13b57b1cc022968655bff90b6fe9076a17103a615
Sep 08 15:44:34.834052 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:34.833952    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5777e7_673f_433b_8801_c987cdb4b1b8.slice/crio-b30c246e1e1169c388ed3e9ffa5927ef9faefaa69c57d5018a8fdefda01c455f WatchSource:0}: Error finding container b30c246e1e1169c388ed3e9ffa5927ef9faefaa69c57d5018a8fdefda01c455f: Status 404 returned error can't find the container with id b30c246e1e1169c388ed3e9ffa5927ef9faefaa69c57d5018a8fdefda01c455f
Sep 08 15:44:34.836672 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:34.836649    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf33e832_454f_4983_828c_059875e55c08.slice/crio-bc70dc09170fda4c5cdc98a0a8cf9ed225b20b602415223f43c80f3c6d48f6af WatchSource:0}: Error finding container bc70dc09170fda4c5cdc98a0a8cf9ed225b20b602415223f43c80f3c6d48f6af: Status 404 returned error can't find the container with id bc70dc09170fda4c5cdc98a0a8cf9ed225b20b602415223f43c80f3c6d48f6af
Sep 08 15:44:34.837410 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:34.837365    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67fc07f_ff1d_4865_84d8_67b1a0cc2fa7.slice/crio-c6e09ea24a905d49c9d703124c7fd6a238a627d6455660e9aa9213b439e47771 WatchSource:0}: Error finding container c6e09ea24a905d49c9d703124c7fd6a238a627d6455660e9aa9213b439e47771: Status 404 returned error can't find the container with id c6e09ea24a905d49c9d703124c7fd6a238a627d6455660e9aa9213b439e47771
Sep 08 15:44:34.843061 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:34.843036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:34.843172 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:34.843159    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:34.843224 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:34.843215    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret podName:ec19266e-6f33-48f8-a4fd-f09a750a0e57 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:35.84319974 +0000 UTC m=+3.965355333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret") pod "global-pull-secret-syncer-q5jph" (UID: "ec19266e-6f33-48f8-a4fd-f09a750a0e57") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:34.944169 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:34.944130    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:34.944355 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:34.944311    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:34.944426 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:34.944396    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs podName:7f248c91-519f-4278-a822-ed12fcee59d0 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:35.944374762 +0000 UTC m=+4.066530375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs") pod "network-metrics-daemon-tk7z8" (UID: "7f248c91-519f-4278-a822-ed12fcee59d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:35.045331 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.045249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjs8\" (UniqueName: \"kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8\") pod \"network-check-target-zfd8g\" (UID: \"8b206d20-85f6-4f51-a10c-dff318621c06\") " pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:35.045489 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:35.045449    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:44:35.045489 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:35.045475    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:44:35.045489 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:35.045489    2581 projected.go:196] Error preparing data for projected volume kube-api-access-lpjs8 for pod openshift-network-diagnostics/network-check-target-zfd8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:35.045640 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:35.045558    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8 podName:8b206d20-85f6-4f51-a10c-dff318621c06 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:36.045537089 +0000 UTC m=+4.167692702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpjs8" (UniqueName: "kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8") pod "network-check-target-zfd8g" (UID: "8b206d20-85f6-4f51-a10c-dff318621c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:35.262763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.262725    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 15:39:34 +0000 UTC" deadline="2028-03-22 22:46:57.65835512 +0000 UTC"
Sep 08 15:44:35.263290 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.262772    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13471h2m22.395600755s"
Sep 08 15:44:35.368845 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.368737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gr864" event={"ID":"94657cce-2a40-4616-a505-beb24b11159d","Type":"ContainerStarted","Data":"58bdfea371e86177ffdcf74be8601ac04bdffbcc5b4781dfb857e495fb47cff7"}
Sep 08 15:44:35.370538 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.370447    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rsff8" event={"ID":"f4d487fe-c0f8-427a-8ed1-66d412972925","Type":"ContainerStarted","Data":"aaf22712fc3a4d812396ee9cb6fad346109d7669fd33d7f59580be6e731c9819"}
Sep 08 15:44:35.371997 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.371920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8mfgw" event={"ID":"6e5777e7-673f-433b-8801-c987cdb4b1b8","Type":"ContainerStarted","Data":"b30c246e1e1169c388ed3e9ffa5927ef9faefaa69c57d5018a8fdefda01c455f"}
Sep 08 15:44:35.373905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.373744    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ns5fg" event={"ID":"80d28796-7d3c-4876-b0e8-acfc6c4eef23","Type":"ContainerStarted","Data":"4f21f53fa378700d5e6f093f77b6be771ca7cbe61c98e10915468ec1b6dfa290"}
Sep 08 15:44:35.376112 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.375999    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b47kh" event={"ID":"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7","Type":"ContainerStarted","Data":"c6e09ea24a905d49c9d703124c7fd6a238a627d6455660e9aa9213b439e47771"}
Sep 08 15:44:35.377737 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.377709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt496" event={"ID":"bf33e832-454f-4983-828c-059875e55c08","Type":"ContainerStarted","Data":"bc70dc09170fda4c5cdc98a0a8cf9ed225b20b602415223f43c80f3c6d48f6af"}
Sep 08 15:44:35.379767 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.379724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vnv7m" event={"ID":"58f3e0d6-9b77-4370-b753-d9fe5fe6769d","Type":"ContainerStarted","Data":"829d04c8d481d3e79d1a7adb2c9939c07b215e69cec859bec16a2ad70b1f03be"}
Sep 08 15:44:35.381729 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.381602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs" event={"ID":"b2adb38c-9df2-48ea-9589-da7313708ae6","Type":"ContainerStarted","Data":"7ab097c9b28b80aa3ee702f13b57b1cc022968655bff90b6fe9076a17103a615"}
Sep 08 15:44:35.383093 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.382995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2nssl" event={"ID":"c699be0a-a30b-4a97-a4f4-07ff2af26e1f","Type":"ContainerStarted","Data":"0cd9270d8cf42883f077befda3c2f28ef46a5736112170162412586a1cef548b"}
Sep 08 15:44:35.385928 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.385900    2581 generic.go:356] "Generic (PLEG): container finished" podID="386588c28009e12e1e0236c3f6df40f3" containerID="b075fb63116fe16ccfeee0b743f6902f19cf5726428931c5776507b516028735" exitCode=0
Sep 08 15:44:35.386049 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.385940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal" event={"ID":"386588c28009e12e1e0236c3f6df40f3","Type":"ContainerDied","Data":"b075fb63116fe16ccfeee0b743f6902f19cf5726428931c5776507b516028735"}
Sep 08 15:44:35.589671 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:44:35.589604    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc58ec07b60ea490ac16da8d8db6186.slice/crio-0df7e46ff56d97fc3431c34d82d2577b95c8e7c80ac6fd1b7deba19e986259bb WatchSource:0}: Error finding container 0df7e46ff56d97fc3431c34d82d2577b95c8e7c80ac6fd1b7deba19e986259bb: Status 404 returned error can't find the container with id 0df7e46ff56d97fc3431c34d82d2577b95c8e7c80ac6fd1b7deba19e986259bb
Sep 08 15:44:35.851070 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.851021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:35.851245 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:35.851170    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:35.851245 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:35.851233    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret podName:ec19266e-6f33-48f8-a4fd-f09a750a0e57 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:37.851213304 +0000 UTC m=+5.973368910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret") pod "global-pull-secret-syncer-q5jph" (UID: "ec19266e-6f33-48f8-a4fd-f09a750a0e57") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:35.952843 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:35.952272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:35.952843 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:35.952431    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:35.952843 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:35.952493    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs podName:7f248c91-519f-4278-a822-ed12fcee59d0 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:37.952474523 +0000 UTC m=+6.074630127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs") pod "network-metrics-daemon-tk7z8" (UID: "7f248c91-519f-4278-a822-ed12fcee59d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:36.052895 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:36.052859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjs8\" (UniqueName: \"kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8\") pod \"network-check-target-zfd8g\" (UID: \"8b206d20-85f6-4f51-a10c-dff318621c06\") " pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:36.053084 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:36.053066    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:44:36.053150 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:36.053092    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:44:36.053150 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:36.053106    2581 projected.go:196] Error preparing data for projected volume kube-api-access-lpjs8 for pod openshift-network-diagnostics/network-check-target-zfd8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:36.053254 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:36.053160    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8 podName:8b206d20-85f6-4f51-a10c-dff318621c06 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:38.053144165 +0000 UTC m=+6.175299761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpjs8" (UniqueName: "kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8") pod "network-check-target-zfd8g" (UID: "8b206d20-85f6-4f51-a10c-dff318621c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:36.263885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:36.263807    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 15:39:34 +0000 UTC" deadline="2028-03-10 15:30:12.143836585 +0000 UTC"
Sep 08 15:44:36.264485 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:36.263915    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13175h45m35.879927182s"
Sep 08 15:44:36.361446 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:36.361131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:36.361446 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:36.361131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:36.361446 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:36.361252    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:36.361446 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:36.361276    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:36.361446 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:36.361377    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:36.361835 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:36.361464    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:36.393958 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:36.393920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal" event={"ID":"386588c28009e12e1e0236c3f6df40f3","Type":"ContainerStarted","Data":"49828a50332982fb8a8cdbd6fcba8218a6649b0f8bca7c876f94a07ae2f8b6a2"}
Sep 08 15:44:36.397043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:36.397013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal" event={"ID":"acc58ec07b60ea490ac16da8d8db6186","Type":"ContainerStarted","Data":"0df7e46ff56d97fc3431c34d82d2577b95c8e7c80ac6fd1b7deba19e986259bb"}
Sep 08 15:44:36.408766 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:36.408698    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-238.ec2.internal" podStartSLOduration=3.408668181 podStartE2EDuration="3.408668181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:36.408229707 +0000 UTC m=+4.530385323" watchObservedRunningTime="2026-09-08 15:44:36.408668181 +0000 UTC m=+4.530823797"
Sep 08 15:44:37.866530 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:37.866483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:37.867263 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:37.866652    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:37.867263 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:37.866733    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret podName:ec19266e-6f33-48f8-a4fd-f09a750a0e57 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:41.866713101 +0000 UTC m=+9.988868708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret") pod "global-pull-secret-syncer-q5jph" (UID: "ec19266e-6f33-48f8-a4fd-f09a750a0e57") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:37.967835 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:37.967786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:37.967998 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:37.967943    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:37.968051 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:37.968013    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs podName:7f248c91-519f-4278-a822-ed12fcee59d0 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:41.967993728 +0000 UTC m=+10.090149324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs") pod "network-metrics-daemon-tk7z8" (UID: "7f248c91-519f-4278-a822-ed12fcee59d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:38.068996 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:38.068958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjs8\" (UniqueName: \"kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8\") pod \"network-check-target-zfd8g\" (UID: \"8b206d20-85f6-4f51-a10c-dff318621c06\") " pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:38.069180 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:38.069118    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:44:38.069180 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:38.069142    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:44:38.069180 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:38.069155    2581 projected.go:196] Error preparing data for projected volume kube-api-access-lpjs8 for pod openshift-network-diagnostics/network-check-target-zfd8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:38.069326 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:38.069220    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8 podName:8b206d20-85f6-4f51-a10c-dff318621c06 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:42.069195699 +0000 UTC m=+10.191351292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpjs8" (UniqueName: "kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8") pod "network-check-target-zfd8g" (UID: "8b206d20-85f6-4f51-a10c-dff318621c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:38.359923 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:38.359854    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:38.359923 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:38.359883    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:38.360169 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:38.359862    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:38.360169 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:38.360017    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:38.360270 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:38.360208    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:38.360463 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:38.360300    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:40.359859 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:40.359363    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:40.359859 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:40.359511    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:40.360386 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:40.359924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:40.360386 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:40.360033    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:40.360386 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:40.360133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:40.360386 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:40.360235    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:41.904156 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:41.904097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:41.904620 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:41.904272    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:41.904620 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:41.904350    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret podName:ec19266e-6f33-48f8-a4fd-f09a750a0e57 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:49.904333595 +0000 UTC m=+18.026489188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret") pod "global-pull-secret-syncer-q5jph" (UID: "ec19266e-6f33-48f8-a4fd-f09a750a0e57") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:42.005267 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:42.005228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:42.005445 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:42.005379    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:42.005517 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:42.005454    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs podName:7f248c91-519f-4278-a822-ed12fcee59d0 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:50.005432988 +0000 UTC m=+18.127588592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs") pod "network-metrics-daemon-tk7z8" (UID: "7f248c91-519f-4278-a822-ed12fcee59d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:42.105733 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:42.105590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjs8\" (UniqueName: \"kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8\") pod \"network-check-target-zfd8g\" (UID: \"8b206d20-85f6-4f51-a10c-dff318621c06\") " pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:42.105937 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:42.105794    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:44:42.105937 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:42.105836    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:44:42.105937 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:42.105851    2581 projected.go:196] Error preparing data for projected volume kube-api-access-lpjs8 for pod openshift-network-diagnostics/network-check-target-zfd8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:42.105937 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:42.105911    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8 podName:8b206d20-85f6-4f51-a10c-dff318621c06 nodeName:}" failed. No retries permitted until 2026-09-08 15:44:50.105892616 +0000 UTC m=+18.228048215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpjs8" (UniqueName: "kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8") pod "network-check-target-zfd8g" (UID: "8b206d20-85f6-4f51-a10c-dff318621c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:42.361641 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:42.360959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:42.361641 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:42.361071    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:42.361641 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:42.361479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:42.361641 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:42.361590    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:42.362158 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:42.362031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:42.362158 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:42.362126    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:44.359460 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:44.359426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:44.359990 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:44.359438    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:44.359990 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:44.359564    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:44.359990 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:44.359581    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:44.359990 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:44.359686    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:44.359990 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:44.359746    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:46.360246 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:46.360202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:46.360710 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:46.360218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:46.360710 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:46.360470    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:46.360710 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:46.360338    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:46.360710 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:46.360202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:46.360710 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:46.360564    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:48.359421 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:48.359384    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:48.359903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:48.359384    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:48.359903 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:48.359528    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:48.359903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:48.359388    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:48.359903 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:48.359608    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:48.359903 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:48.359672    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:49.965343 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:49.965302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:49.965875 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:49.965477    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:49.965875 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:49.965564    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret podName:ec19266e-6f33-48f8-a4fd-f09a750a0e57 nodeName:}" failed. No retries permitted until 2026-09-08 15:45:05.965543808 +0000 UTC m=+34.087699401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret") pod "global-pull-secret-syncer-q5jph" (UID: "ec19266e-6f33-48f8-a4fd-f09a750a0e57") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:44:50.066718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:50.066679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:50.066908 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:50.066813    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:50.066908 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:50.066898    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs podName:7f248c91-519f-4278-a822-ed12fcee59d0 nodeName:}" failed. No retries permitted until 2026-09-08 15:45:06.066876751 +0000 UTC m=+34.189032355 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs") pod "network-metrics-daemon-tk7z8" (UID: "7f248c91-519f-4278-a822-ed12fcee59d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:44:50.167321 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:50.167276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjs8\" (UniqueName: \"kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8\") pod \"network-check-target-zfd8g\" (UID: \"8b206d20-85f6-4f51-a10c-dff318621c06\") " pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:50.167495 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:50.167463    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:44:50.167495 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:50.167485    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:44:50.167577 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:50.167498    2581 projected.go:196] Error preparing data for projected volume kube-api-access-lpjs8 for pod openshift-network-diagnostics/network-check-target-zfd8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:50.167577 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:50.167560    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8 podName:8b206d20-85f6-4f51-a10c-dff318621c06 nodeName:}" failed. No retries permitted until 2026-09-08 15:45:06.167546521 +0000 UTC m=+34.289702113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpjs8" (UniqueName: "kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8") pod "network-check-target-zfd8g" (UID: "8b206d20-85f6-4f51-a10c-dff318621c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:44:50.360203 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:50.360078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:50.360378 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:50.360224    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:50.360378 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:50.360078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:50.360378 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:50.360365    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:50.360561 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:50.360091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:50.360561 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:50.360479    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:52.362683 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:52.362653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:52.363163 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:52.362762    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:52.363163 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:52.362665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:52.363163 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:52.362651    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:52.363163 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:52.362893    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:52.363163 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:52.362973    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:53.436205 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:53.436019    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gr864" event={"ID":"94657cce-2a40-4616-a505-beb24b11159d","Type":"ContainerStarted","Data":"72d4df115cb3e2da92ca90f41e58cbe57bc570f5638192038dae81c5ef66a4c6"}
Sep 08 15:44:53.452658 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:53.452602    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gr864" podStartSLOduration=7.606081736 podStartE2EDuration="21.452579205s" totalImagesPullingTime="13.846497469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:53.45186468 +0000 UTC m=+21.574020305" watchObservedRunningTime="2026-09-08 15:44:53.452579205 +0000 UTC m=+21.574734821"
Sep 08 15:44:54.360155 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.359918    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:54.360309 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.359933    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:54.360309 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:54.360195    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:54.360309 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.359965    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:54.360309 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:54.360273    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:54.360518 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:54.360363    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:54.440325 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.440281    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vnv7m" event={"ID":"58f3e0d6-9b77-4370-b753-d9fe5fe6769d","Type":"ContainerStarted","Data":"c2af463f53409c10c6faf14fc3441a1cba31b774ca5fde139e83c29cfe877c2c"}
Sep 08 15:44:54.442113 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.442079    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs" event={"ID":"b2adb38c-9df2-48ea-9589-da7313708ae6","Type":"ContainerStarted","Data":"ade129fa41d6a1431ce8ea10a3bb2143c4c32832aacb548cbbc1f2c7a704feaf"}
Sep 08 15:44:54.443713 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.443684    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2nssl" event={"ID":"c699be0a-a30b-4a97-a4f4-07ff2af26e1f","Type":"ContainerStarted","Data":"693f07d7c5312a7d87400d3f1ff326a38714ad9283e59c96524a53ed67ccefd9"}
Sep 08 15:44:54.445339 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.445307    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal" event={"ID":"acc58ec07b60ea490ac16da8d8db6186","Type":"ContainerStarted","Data":"7672476afd37ff263aa71ec037334f6d0be8ab295067c0461c58d0b8d91b90a3"}
Sep 08 15:44:54.446961 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.446930    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rsff8" event={"ID":"f4d487fe-c0f8-427a-8ed1-66d412972925","Type":"ContainerStarted","Data":"b5e90ff0cee564028002e2ab94bc1cc03f2eb6bb0830bf4b6c76b87b493658f9"}
Sep 08 15:44:54.448576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.448553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8mfgw" event={"ID":"6e5777e7-673f-433b-8801-c987cdb4b1b8","Type":"ContainerStarted","Data":"77933833eb8da365ddf9a733200e7181dd5f5d5584fbaebe7d017cfbed9912b3"}
Sep 08 15:44:54.450168 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.450141    2581 generic.go:356] "Generic (PLEG): container finished" podID="d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7" containerID="0a091ae9c738514a7a4e95e7a726a94987080a44c9897edc28517e0815ca1754" exitCode=0
Sep 08 15:44:54.450256 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.450175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b47kh" event={"ID":"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7","Type":"ContainerDied","Data":"0a091ae9c738514a7a4e95e7a726a94987080a44c9897edc28517e0815ca1754"}
Sep 08 15:44:54.454194 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.454169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt496" event={"ID":"bf33e832-454f-4983-828c-059875e55c08","Type":"ContainerStarted","Data":"528a3a9241da042fa8d89a0fed78ed3100176d1650908534a770a33304111ab8"}
Sep 08 15:44:54.454293 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.454259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt496" event={"ID":"bf33e832-454f-4983-828c-059875e55c08","Type":"ContainerStarted","Data":"7509356d745a3d50e096002d827151048fd427fe06a9547d8fa9b1c4a4d52f83"}
Sep 08 15:44:54.454346 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.454314    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt496" event={"ID":"bf33e832-454f-4983-828c-059875e55c08","Type":"ContainerStarted","Data":"40566a1d19736d72a898fafdd183169d3322b85436007803f4cd45acb7267eea"}
Sep 08 15:44:54.454378 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.454347    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt496" event={"ID":"bf33e832-454f-4983-828c-059875e55c08","Type":"ContainerStarted","Data":"fe5b300a2af4c3868fb34827cbef3830839015d78d1f40c94e6a77186ead5dbb"}
Sep 08 15:44:54.454415 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.454392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt496" event={"ID":"bf33e832-454f-4983-828c-059875e55c08","Type":"ContainerStarted","Data":"356ae5bbbc0cf74bf73fe86996e3fbf3de008c77a012ee998c95bfaf38eec6d1"}
Sep 08 15:44:54.454448 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.454425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt496" event={"ID":"bf33e832-454f-4983-828c-059875e55c08","Type":"ContainerStarted","Data":"ba77e7d3445c7329aabd64d66dda710068a45f329751a7fd21d6bf40eae45e04"}
Sep 08 15:44:54.455934 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.455896    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vnv7m" podStartSLOduration=3.8174750189999997 podStartE2EDuration="22.455881682s" totalImagesPullingTime="18.638406663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:54.455704489 +0000 UTC m=+22.577860106" watchObservedRunningTime="2026-09-08 15:44:54.455881682 +0000 UTC m=+22.578037301"
Sep 08 15:44:54.494706 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.494652    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rsff8" podStartSLOduration=3.8467444840000002 podStartE2EDuration="22.494636604s" totalImagesPullingTime="18.64789212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:54.4944057 +0000 UTC m=+22.616561316" watchObservedRunningTime="2026-09-08 15:44:54.494636604 +0000 UTC m=+22.616792219"
Sep 08 15:44:54.507443 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.507385    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-238.ec2.internal" podStartSLOduration=21.507363916 podStartE2EDuration="21.507363916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:54.506905777 +0000 UTC m=+22.629061393" watchObservedRunningTime="2026-09-08 15:44:54.507363916 +0000 UTC m=+22.629519532"
Sep 08 15:44:54.529497 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.529443    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2nssl" podStartSLOduration=4.067205493 podStartE2EDuration="22.529425856s" totalImagesPullingTime="18.462220363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:54.529019778 +0000 UTC m=+22.651175393" watchObservedRunningTime="2026-09-08 15:44:54.529425856 +0000 UTC m=+22.651581519"
Sep 08 15:44:54.544179 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.544130    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8mfgw" podStartSLOduration=4.17015948 podStartE2EDuration="22.544113993s" totalImagesPullingTime="18.373954513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:54.54404765 +0000 UTC m=+22.666203265" watchObservedRunningTime="2026-09-08 15:44:54.544113993 +0000 UTC m=+22.666269608"
Sep 08 15:44:54.645950 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.645912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:54.720624 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.720574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:54.965028 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:54.964858    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 15:44:55.373763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:55.373543    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T15:44:54.965020526Z","UUID":"869afe9e-7a19-408f-b85a-5affc106e755","Handler":null,"Name":"","Endpoint":""}
Sep 08 15:44:55.375647 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:55.375623    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 15:44:55.375807 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:55.375658    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 15:44:55.458393 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:55.458356    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ns5fg" event={"ID":"80d28796-7d3c-4876-b0e8-acfc6c4eef23","Type":"ContainerStarted","Data":"ba9fd24c9d637b42d1239de77d330ab09b29a097fa6046fcd4dfa65f991d6887"}
Sep 08 15:44:55.460304 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:55.460280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs" event={"ID":"b2adb38c-9df2-48ea-9589-da7313708ae6","Type":"ContainerStarted","Data":"dcae1d1501e586ed6c2f9eaa50b093ba3d3898c40df9f0a2fa41158b22d4aaf7"}
Sep 08 15:44:55.479130 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:55.479081    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ns5fg" podStartSLOduration=4.992254104 podStartE2EDuration="23.479065253s" totalImagesPullingTime="18.486811149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:55.479003603 +0000 UTC m=+23.601159218" watchObservedRunningTime="2026-09-08 15:44:55.479065253 +0000 UTC m=+23.601220897"
Sep 08 15:44:55.644067 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:55.643966    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:55.749419 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:55.749377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:56.362403 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:56.362366    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:56.362403 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:56.362406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:56.362621 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:56.362478    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:56.362621 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:56.362504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:56.362621 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:56.362561    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:56.362621 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:56.362619    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:56.466411 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:56.466321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt496" event={"ID":"bf33e832-454f-4983-828c-059875e55c08","Type":"ContainerStarted","Data":"9ed04f2d96bfd10ebb6ef2f57fcb7f44e8a31a967b0eee18bfac238cf8728759"}
Sep 08 15:44:57.026645 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:57.026612    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:58.363360 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:58.363332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:44:58.363948 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:58.363431    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:44:58.363948 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:58.363450    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:44:58.363948 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:58.363463    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:44:58.363948 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:58.363566    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:44:58.363948 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:44:58.363633    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:44:58.377458 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:58.377426    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:58.378328 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:58.378300    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:58.471216 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:58.471187    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gr864"
Sep 08 15:44:59.196406 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:59.196372    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:59.257030 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:59.256998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:59.357457 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:59.357428    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:59.550140 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:59.550057    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:59.651000 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:44:59.650968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:00.297546 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.297368    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:00.359700 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.359666    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:00.359884 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.359680    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:00.359884 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:00.359766    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:00.359966 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:00.359881    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:00.359966 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.359941    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:00.360067 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:00.360025    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:00.397063 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.397026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:00.476556 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.476524    2581 generic.go:356] "Generic (PLEG): container finished" podID="d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7" containerID="81ff648114471e7aa9607f644a1d6bf89bdb04d8aaec9519bec631f49b54be72" exitCode=0
Sep 08 15:45:00.476713 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.476611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b47kh" event={"ID":"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7","Type":"ContainerDied","Data":"81ff648114471e7aa9607f644a1d6bf89bdb04d8aaec9519bec631f49b54be72"}
Sep 08 15:45:00.480453 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.480429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt496" event={"ID":"bf33e832-454f-4983-828c-059875e55c08","Type":"ContainerStarted","Data":"df87be013403a8fdd0aa954def7a42e3d9ac07292c1689131d475e00cc067de6"}
Sep 08 15:45:00.480709 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.480685    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:45:00.480841 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.480760    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:45:00.482630 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.482607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs" event={"ID":"b2adb38c-9df2-48ea-9589-da7313708ae6","Type":"ContainerStarted","Data":"c2ce1b4bacf674ff1f0c2015e8648b43dbf7c87ae3f08fb7f7fa547e9571a41f"}
Sep 08 15:45:00.495940 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.495914    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:45:00.510439 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.510418    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8mfgw_6e5777e7-673f-433b-8801-c987cdb4b1b8/dns-node-resolver/0.log"
Sep 08 15:45:00.524113 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.524067    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjjfs" podStartSLOduration=4.057473342 podStartE2EDuration="28.524050687s" totalImagesPullingTime="24.466577345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:00.523980168 +0000 UTC m=+28.646135783" watchObservedRunningTime="2026-09-08 15:45:00.524050687 +0000 UTC m=+28.646206301"
Sep 08 15:45:00.562859 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:00.562735    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nt496" podStartSLOduration=10.086740323 podStartE2EDuration="28.562718197s" totalImagesPullingTime="18.475977874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:00.562493472 +0000 UTC m=+28.684649087" watchObservedRunningTime="2026-09-08 15:45:00.562718197 +0000 UTC m=+28.684873834"
Sep 08 15:45:01.189372 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.189340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:01.288033 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.287948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:01.485674 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.485641    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:45:01.503005 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.502975    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:45:01.892288 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.891950    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q5jph"]
Sep 08 15:45:01.892865 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.892364    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:01.892865 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:01.892467    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:01.897338 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.897309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zfd8g"]
Sep 08 15:45:01.897486 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.897439    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:01.897558 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:01.897533    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:01.897998 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.897977    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tk7z8"]
Sep 08 15:45:01.898097 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.898079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:01.898191 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:01.898165    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:01.911273 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:01.911246    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vnv7m_58f3e0d6-9b77-4370-b753-d9fe5fe6769d/node-ca/0.log"
Sep 08 15:45:02.106547 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:02.106498    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:02.489359 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:02.489329    2581 generic.go:356] "Generic (PLEG): container finished" podID="d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7" containerID="5a95837be024869dbff74e82eedc38417b634d956fa616c722390898ebdb60d1" exitCode=0
Sep 08 15:45:02.489542 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:02.489420    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b47kh" event={"ID":"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7","Type":"ContainerDied","Data":"5a95837be024869dbff74e82eedc38417b634d956fa616c722390898ebdb60d1"}
Sep 08 15:45:03.359449 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:03.359367    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:03.359857 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:03.359471    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:03.359857 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:03.359525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:03.359857 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:03.359620    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:03.636441 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:03.636363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:04.359280 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:04.359241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:04.359458 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:04.359389    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:04.497585 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:04.497549    2581 generic.go:356] "Generic (PLEG): container finished" podID="d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7" containerID="abb9b46700356d7747057554332cbf628fe2564748eaa64cc07e5b6f1b9280d2" exitCode=0
Sep 08 15:45:04.498016 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:04.497598    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b47kh" event={"ID":"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7","Type":"ContainerDied","Data":"abb9b46700356d7747057554332cbf628fe2564748eaa64cc07e5b6f1b9280d2"}
Sep 08 15:45:05.359233 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:05.359195    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:05.359423 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:05.359195    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:05.359423 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:05.359298    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:05.359423 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:05.359375    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:05.955386 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:05.955345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:05.981568 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:05.981523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:05.981744 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:05.981685    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:45:05.981783 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:05.981749    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret podName:ec19266e-6f33-48f8-a4fd-f09a750a0e57 nodeName:}" failed. No retries permitted until 2026-09-08 15:45:37.981733562 +0000 UTC m=+66.103889155 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret") pod "global-pull-secret-syncer-q5jph" (UID: "ec19266e-6f33-48f8-a4fd-f09a750a0e57") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:45:06.054527 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:06.054477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:06.082530 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:06.082494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:06.082718 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:06.082663    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:45:06.082799 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:06.082742    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs podName:7f248c91-519f-4278-a822-ed12fcee59d0 nodeName:}" failed. No retries permitted until 2026-09-08 15:45:38.082721911 +0000 UTC m=+66.204877505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs") pod "network-metrics-daemon-tk7z8" (UID: "7f248c91-519f-4278-a822-ed12fcee59d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:45:06.183153 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:06.183109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjs8\" (UniqueName: \"kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8\") pod \"network-check-target-zfd8g\" (UID: \"8b206d20-85f6-4f51-a10c-dff318621c06\") " pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:06.183331 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:06.183279    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:45:06.183331 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:06.183304    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:45:06.183331 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:06.183314    2581 projected.go:196] Error preparing data for projected volume kube-api-access-lpjs8 for pod openshift-network-diagnostics/network-check-target-zfd8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:45:06.183449 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:06.183366    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8 podName:8b206d20-85f6-4f51-a10c-dff318621c06 nodeName:}" failed. No retries permitted until 2026-09-08 15:45:38.183351691 +0000 UTC m=+66.305507289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpjs8" (UniqueName: "kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8") pod "network-check-target-zfd8g" (UID: "8b206d20-85f6-4f51-a10c-dff318621c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:45:06.359578 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:06.359490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:06.359761 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:06.359726    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:06.458899 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:06.458861    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:06.559684 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:06.559633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:06.735878 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:06.735839    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:06.865164 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:06.865120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:07.063384 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:07.063263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:07.271239 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:07.271201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:07.359349 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:07.359261    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:07.359349 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:07.359305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:07.359585 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:07.359383    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:07.359585 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:07.359469    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:07.668491 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:07.668450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:07.734216 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:07.734183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:08.065877 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:08.065775    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:08.256597 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:08.256562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:08.360231 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:08.360140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:08.360399 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:08.360268    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:08.625146 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:08.625050    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:08.725452 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:08.725389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:09.359797 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:09.359763    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:09.360260 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:09.359908    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:09.360260 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:09.359953    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:09.360260 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:09.360052    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:09.464243 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:09.464209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:09.511154 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:09.511069    2581 generic.go:356] "Generic (PLEG): container finished" podID="d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7" containerID="7743e4181aec6561ff9ccaf92a40883d40525ff147acf890883ea92b81298b12" exitCode=0
Sep 08 15:45:09.511154 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:09.511125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b47kh" event={"ID":"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7","Type":"ContainerDied","Data":"7743e4181aec6561ff9ccaf92a40883d40525ff147acf890883ea92b81298b12"}
Sep 08 15:45:09.538569 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:09.538539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:09.854956 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:09.854697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:10.052649 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:10.052611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:10.362686 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:10.362657    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:10.363102 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:10.362794    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:10.463304 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:10.463266    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:10.515533 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:10.515503    2581 generic.go:356] "Generic (PLEG): container finished" podID="d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7" containerID="d71544548f559f93d24afee5644def168cb7cf3aea18acc3b2a252198e380c9a" exitCode=0
Sep 08 15:45:10.515717 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:10.515558    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b47kh" event={"ID":"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7","Type":"ContainerDied","Data":"d71544548f559f93d24afee5644def168cb7cf3aea18acc3b2a252198e380c9a"}
Sep 08 15:45:10.872783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:10.872733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:10.971196 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:10.971159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:11.359791 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:11.359710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:11.359956 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:11.359710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:11.359956 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:11.359812    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:11.359956 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:11.359911    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:11.456122 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:11.456087    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:11.522188 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:11.522154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b47kh" event={"ID":"d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7","Type":"ContainerStarted","Data":"4f237e9c9f432d13bf8fcddc0a207810640e0363fd0f4c7ef6a419931811ec52"}
Sep 08 15:45:11.546195 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:11.546140    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b47kh" podStartSLOduration=8.555198491 podStartE2EDuration="39.546124374s" totalImagesPullingTime="30.990925883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:11.545882451 +0000 UTC m=+39.668038066" watchObservedRunningTime="2026-09-08 15:45:11.546124374 +0000 UTC m=+39.668279988"
Sep 08 15:45:11.600185 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:11.600153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:11.700324 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:11.700291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:12.054208 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:12.054111    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:12.263277 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:12.263241    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:12.360686 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:12.360604    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:12.360832 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:12.360699    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:12.405020 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:12.404975    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:12.505454 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:12.505405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:12.854526 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:12.854492    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:13.285998 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:13.285965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:13.360008 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:13.359979    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:13.360137 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:13.360080    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:13.360190 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:13.360136    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:13.360238 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:13.360221    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:13.631949 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:13.631858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:13.852107 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:13.852072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:14.267235 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:14.267193    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:14.359351 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:14.359311    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:14.359539 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:14.359446    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:14.454888 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:14.454802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:14.653436 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:14.653387    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:15.359801 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:15.359765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:15.360017 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:15.359765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:15.360017 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:15.359910    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:15.360017 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:15.359932    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:16.359654 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:16.359618    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:16.360048 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:16.359735    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:17.359317 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:17.359282    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:17.359474 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:17.359284    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:17.359474 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:17.359382    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:17.359474 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:17.359455    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:18.360088 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:18.360051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:18.360488 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:18.360199    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:19.359779 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:19.359746    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:19.359980 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:19.359804    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:19.359980 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:19.359889    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:19.360051 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:19.359964    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:20.359900 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:20.359860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:20.360324 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:20.359977    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:20.867023 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:20.866992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:20.922832 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:20.922784    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:21.235537 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:21.235499    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:21.292408 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:21.292365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:21.359603 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:21.359570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:21.359603 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:21.359603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:21.359774 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:21.359692    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:21.359833 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:21.359804    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:21.643571 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:21.643490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:21.709472 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:21.709444    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:21.838908 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:21.838877    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:21.940673 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:21.940645    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:22.251355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:22.251280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:22.361790 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:22.361190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:22.361790 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:22.361360    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:22.463180 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:22.463143    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:22.680167 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:22.680131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:23.359838 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:23.359793    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:23.360022 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:23.359858    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:23.360022 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:23.359925    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfd8g" podUID="8b206d20-85f6-4f51-a10c-dff318621c06"
Sep 08 15:45:23.360102 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:23.360021    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5jph" podUID="ec19266e-6f33-48f8-a4fd-f09a750a0e57"
Sep 08 15:45:23.467120 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:23.467082    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:24.359328 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:24.359286    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:24.359812 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:24.359417    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk7z8" podUID="7f248c91-519f-4278-a822-ed12fcee59d0"
Sep 08 15:45:25.172927 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.172895    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-238.ec2.internal" event="NodeReady"
Sep 08 15:45:25.173087 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.173037    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 15:45:25.208050 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.208012    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"]
Sep 08 15:45:25.209741 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.209722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.212010 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.211988    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6lw5f\""
Sep 08 15:45:25.212401 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.212386    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 15:45:25.212598 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.212405    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 15:45:25.212839 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.212802    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 15:45:25.220487 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.220454    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 15:45:25.229182 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.229155    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kkv8k"]
Sep 08 15:45:25.231208 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.231185    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kkv8k"
Sep 08 15:45:25.231434 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.231373    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"]
Sep 08 15:45:25.232051 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.232033    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6h9df"]
Sep 08 15:45:25.233447 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.233422    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 15:45:25.233799 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.233753    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 15:45:25.233799 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.233781    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 15:45:25.233799 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.233793    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z2m58\""
Sep 08 15:45:25.234010 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.233900    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.236815 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.236795    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 15:45:25.236939 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.236839    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 15:45:25.236939 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.236876    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 15:45:25.237094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.236940    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rhb4d\""
Sep 08 15:45:25.237231 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.237219    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 15:45:25.243145 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.243124    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kkv8k"]
Sep 08 15:45:25.247718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.247695    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6h9df"]
Sep 08 15:45:25.323980 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.323899    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-89ltc"]
Sep 08 15:45:25.325288 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-registry-tls\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.325370 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-trusted-ca\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.325370 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-bound-sa-token\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.325370 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpm8c\" (UniqueName: \"kubernetes.io/projected/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-kube-api-access-gpm8c\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.325370 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-registry-certificates\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.325617 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-image-registry-private-configuration\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.325617 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5242e48-8452-44ce-99c0-d72cf7485389-cert\") pod \"ingress-canary-kkv8k\" (UID: \"e5242e48-8452-44ce-99c0-d72cf7485389\") " pod="openshift-ingress-canary/ingress-canary-kkv8k"
Sep 08 15:45:25.325617 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-ca-trust-extracted\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.325617 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h59wh\" (UniqueName: \"kubernetes.io/projected/e5242e48-8452-44ce-99c0-d72cf7485389-kube-api-access-h59wh\") pod \"ingress-canary-kkv8k\" (UID: \"e5242e48-8452-44ce-99c0-d72cf7485389\") " pod="openshift-ingress-canary/ingress-canary-kkv8k"
Sep 08 15:45:25.325617 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-installation-pull-secrets\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.325776 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.325757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.327931 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.327912    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 15:45:25.328074 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.327976    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 15:45:25.328131 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.328096    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qhh8b\""
Sep 08 15:45:25.337537 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.337510    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-89ltc"]
Sep 08 15:45:25.359638 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.359603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:25.359638 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.359635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:25.361852 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.361815    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 15:45:25.361965 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.361866    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 15:45:25.361965 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.361908    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 15:45:25.362075 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.361973    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xkdlq\""
Sep 08 15:45:25.426280 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-ca-trust-extracted\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.426280 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h59wh\" (UniqueName: \"kubernetes.io/projected/e5242e48-8452-44ce-99c0-d72cf7485389-kube-api-access-h59wh\") pod \"ingress-canary-kkv8k\" (UID: \"e5242e48-8452-44ce-99c0-d72cf7485389\") " pod="openshift-ingress-canary/ingress-canary-kkv8k"
Sep 08 15:45:25.426543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2949f2-6be5-4492-a713-0a9a3e1b851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.426543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-installation-pull-secrets\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.426543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gngts\" (UniqueName: \"kubernetes.io/projected/7d2949f2-6be5-4492-a713-0a9a3e1b851b-kube-api-access-gngts\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.426543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2949f2-6be5-4492-a713-0a9a3e1b851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.426543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426427    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf6wc\" (UniqueName: \"kubernetes.io/projected/b9c9745d-ab52-4f00-a408-0441edbdf049-kube-api-access-qf6wc\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.426543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2949f2-6be5-4492-a713-0a9a3e1b851b-data-volume\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.426543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c9745d-ab52-4f00-a408-0441edbdf049-config-volume\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.426543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-registry-tls\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.426979 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-trusted-ca\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.426979 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-bound-sa-token\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.426979 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpm8c\" (UniqueName: \"kubernetes.io/projected/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-kube-api-access-gpm8c\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.426979 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-registry-certificates\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.426979 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c9745d-ab52-4f00-a408-0441edbdf049-metrics-tls\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.426979 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-ca-trust-extracted\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.426979 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c9745d-ab52-4f00-a408-0441edbdf049-tmp-dir\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.426979 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-image-registry-private-configuration\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.426979 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.426972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d2949f2-6be5-4492-a713-0a9a3e1b851b-crio-socket\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.427385 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.427030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5242e48-8452-44ce-99c0-d72cf7485389-cert\") pod \"ingress-canary-kkv8k\" (UID: \"e5242e48-8452-44ce-99c0-d72cf7485389\") " pod="openshift-ingress-canary/ingress-canary-kkv8k"
Sep 08 15:45:25.427665 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.427634    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-registry-certificates\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.428155 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.428132    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-trusted-ca\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.430800 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.430759    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-image-registry-private-configuration\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.430953 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.430872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-registry-tls\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.430953 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.430904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-installation-pull-secrets\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.431060 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.430959    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5242e48-8452-44ce-99c0-d72cf7485389-cert\") pod \"ingress-canary-kkv8k\" (UID: \"e5242e48-8452-44ce-99c0-d72cf7485389\") " pod="openshift-ingress-canary/ingress-canary-kkv8k"
Sep 08 15:45:25.433944 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.433921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpm8c\" (UniqueName: \"kubernetes.io/projected/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-kube-api-access-gpm8c\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.434035 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.433942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f48b7c4-3a57-4c95-8401-b9d62b4bdf42-bound-sa-token\") pod \"image-registry-7db6ffdfbf-4wzpm\" (UID: \"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42\") " pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.434035 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.434020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h59wh\" (UniqueName: \"kubernetes.io/projected/e5242e48-8452-44ce-99c0-d72cf7485389-kube-api-access-h59wh\") pod \"ingress-canary-kkv8k\" (UID: \"e5242e48-8452-44ce-99c0-d72cf7485389\") " pod="openshift-ingress-canary/ingress-canary-kkv8k"
Sep 08 15:45:25.520879 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.520842    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:25.527627 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.527602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gngts\" (UniqueName: \"kubernetes.io/projected/7d2949f2-6be5-4492-a713-0a9a3e1b851b-kube-api-access-gngts\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.527709 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.527639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2949f2-6be5-4492-a713-0a9a3e1b851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.527709 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.527671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf6wc\" (UniqueName: \"kubernetes.io/projected/b9c9745d-ab52-4f00-a408-0441edbdf049-kube-api-access-qf6wc\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.527709 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.527700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2949f2-6be5-4492-a713-0a9a3e1b851b-data-volume\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.527862 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.527717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c9745d-ab52-4f00-a408-0441edbdf049-config-volume\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.527862 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.527741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c9745d-ab52-4f00-a408-0441edbdf049-metrics-tls\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.527862 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.527756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c9745d-ab52-4f00-a408-0441edbdf049-tmp-dir\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.528128 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.528102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d2949f2-6be5-4492-a713-0a9a3e1b851b-crio-socket\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.528128 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.528122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c9745d-ab52-4f00-a408-0441edbdf049-tmp-dir\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.528238 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.528122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d2949f2-6be5-4492-a713-0a9a3e1b851b-data-volume\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.528238 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.528193    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d2949f2-6be5-4492-a713-0a9a3e1b851b-crio-socket\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.528332 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.528272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2949f2-6be5-4492-a713-0a9a3e1b851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.528684 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.528659    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c9745d-ab52-4f00-a408-0441edbdf049-config-volume\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.528883 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.528810    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d2949f2-6be5-4492-a713-0a9a3e1b851b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.530239 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.530221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c9745d-ab52-4f00-a408-0441edbdf049-metrics-tls\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.530349 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.530331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d2949f2-6be5-4492-a713-0a9a3e1b851b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.535596 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.535573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf6wc\" (UniqueName: \"kubernetes.io/projected/b9c9745d-ab52-4f00-a408-0441edbdf049-kube-api-access-qf6wc\") pod \"dns-default-89ltc\" (UID: \"b9c9745d-ab52-4f00-a408-0441edbdf049\") " pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.535722 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.535660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gngts\" (UniqueName: \"kubernetes.io/projected/7d2949f2-6be5-4492-a713-0a9a3e1b851b-kube-api-access-gngts\") pod \"insights-runtime-extractor-6h9df\" (UID: \"7d2949f2-6be5-4492-a713-0a9a3e1b851b\") " pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.541561 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.541532    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kkv8k"
Sep 08 15:45:25.546400 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.546377    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6h9df"
Sep 08 15:45:25.629839 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.629787    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:25.634422 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.634392    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:25.812023 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.811989    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"]
Sep 08 15:45:25.815736 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:25.815706    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f48b7c4_3a57_4c95_8401_b9d62b4bdf42.slice/crio-578f0f9b28dcd7a783ffe18655cd9c89db367c3d4cc10cd571a5f745b72919aa WatchSource:0}: Error finding container 578f0f9b28dcd7a783ffe18655cd9c89db367c3d4cc10cd571a5f745b72919aa: Status 404 returned error can't find the container with id 578f0f9b28dcd7a783ffe18655cd9c89db367c3d4cc10cd571a5f745b72919aa
Sep 08 15:45:25.829734 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.829707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kkv8k"]
Sep 08 15:45:25.832299 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:25.832275    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5242e48_8452_44ce_99c0_d72cf7485389.slice/crio-c07d614deb54fa25feb2fa8a3052ede0c93d4cda3684813507c853d4958320b0 WatchSource:0}: Error finding container c07d614deb54fa25feb2fa8a3052ede0c93d4cda3684813507c853d4958320b0: Status 404 returned error can't find the container with id c07d614deb54fa25feb2fa8a3052ede0c93d4cda3684813507c853d4958320b0
Sep 08 15:45:25.839382 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.839349    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6h9df"]
Sep 08 15:45:25.844198 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:25.844169    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2949f2_6be5_4492_a713_0a9a3e1b851b.slice/crio-c23460c4df51e3cf2ae6eada7b24bfff128dc4dffa6421dae1b201f27429e9d1 WatchSource:0}: Error finding container c23460c4df51e3cf2ae6eada7b24bfff128dc4dffa6421dae1b201f27429e9d1: Status 404 returned error can't find the container with id c23460c4df51e3cf2ae6eada7b24bfff128dc4dffa6421dae1b201f27429e9d1
Sep 08 15:45:25.908373 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:25.908344    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-89ltc"]
Sep 08 15:45:25.912282 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:25.912243    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c9745d_ab52_4f00_a408_0441edbdf049.slice/crio-f45bcdbddd5d82b5eb3b73dba375734d7d3721b678a4935e4cb5505494512bee WatchSource:0}: Error finding container f45bcdbddd5d82b5eb3b73dba375734d7d3721b678a4935e4cb5505494512bee: Status 404 returned error can't find the container with id f45bcdbddd5d82b5eb3b73dba375734d7d3721b678a4935e4cb5505494512bee
Sep 08 15:45:26.217509 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.217462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:26.314024 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.313988    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:26.359482 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.359443    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:26.362936 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.362901    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78hmt\""
Sep 08 15:45:26.363379 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.363187    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 15:45:26.427800 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.427733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:26.475502 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.475371    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n"]
Sep 08 15:45:26.478524 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.477650    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n"
Sep 08 15:45:26.481761 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.480379    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 15:45:26.481761 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.480457    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6kprt\""
Sep 08 15:45:26.488978 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.488130    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n"]
Sep 08 15:45:26.507370 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.507321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:26.561930 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.561855    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kkv8k" event={"ID":"e5242e48-8452-44ce-99c0-d72cf7485389","Type":"ContainerStarted","Data":"c07d614deb54fa25feb2fa8a3052ede0c93d4cda3684813507c853d4958320b0"}
Sep 08 15:45:26.564950 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.564803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6h9df" event={"ID":"7d2949f2-6be5-4492-a713-0a9a3e1b851b","Type":"ContainerStarted","Data":"70a951a4f32460943b8a68501925bbea1f1da31042874be7e8918923e57b17f4"}
Sep 08 15:45:26.564950 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.564900    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6h9df" event={"ID":"7d2949f2-6be5-4492-a713-0a9a3e1b851b","Type":"ContainerStarted","Data":"c23460c4df51e3cf2ae6eada7b24bfff128dc4dffa6421dae1b201f27429e9d1"}
Sep 08 15:45:26.566904 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.566871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-89ltc" event={"ID":"b9c9745d-ab52-4f00-a408-0441edbdf049","Type":"ContainerStarted","Data":"f45bcdbddd5d82b5eb3b73dba375734d7d3721b678a4935e4cb5505494512bee"}
Sep 08 15:45:26.569547 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.569515    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm" event={"ID":"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42","Type":"ContainerStarted","Data":"b61c67838b6c87505b5c9819346b4d2687e99ba9334559eff853769530028426"}
Sep 08 15:45:26.569664 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.569569    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm" event={"ID":"9f48b7c4-3a57-4c95-8401-b9d62b4bdf42","Type":"ContainerStarted","Data":"578f0f9b28dcd7a783ffe18655cd9c89db367c3d4cc10cd571a5f745b72919aa"}
Sep 08 15:45:26.569865 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.569841    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:26.595877 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.595596    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm" podStartSLOduration=2.595572181 podStartE2EDuration="2.595572181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:26.594841574 +0000 UTC m=+54.716997182" watchObservedRunningTime="2026-09-08 15:45:26.595572181 +0000 UTC m=+54.717727798"
Sep 08 15:45:26.636521 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.636464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a82a84d3-cccf-4946-8a76-7c7cae5983de-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-2ls7n\" (UID: \"a82a84d3-cccf-4946-8a76-7c7cae5983de\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n"
Sep 08 15:45:26.712491 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.712436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:26.738280 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.738193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a82a84d3-cccf-4946-8a76-7c7cae5983de-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-2ls7n\" (UID: \"a82a84d3-cccf-4946-8a76-7c7cae5983de\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n"
Sep 08 15:45:26.741040 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.741003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a82a84d3-cccf-4946-8a76-7c7cae5983de-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-2ls7n\" (UID: \"a82a84d3-cccf-4946-8a76-7c7cae5983de\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n"
Sep 08 15:45:26.792964 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:26.792925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n"
Sep 08 15:45:27.077241 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:27.077095    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n"]
Sep 08 15:45:27.082793 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:27.082750    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82a84d3_cccf_4946_8a76_7c7cae5983de.slice/crio-4b9bf15e3bd8be81c2bf38a0d780c3a983fc96d52eb5559d3f516678f508d763 WatchSource:0}: Error finding container 4b9bf15e3bd8be81c2bf38a0d780c3a983fc96d52eb5559d3f516678f508d763: Status 404 returned error can't find the container with id 4b9bf15e3bd8be81c2bf38a0d780c3a983fc96d52eb5559d3f516678f508d763
Sep 08 15:45:27.408626 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:27.408590    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:27.466466 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:27.466429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:27.574410 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:27.574367    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n" event={"ID":"a82a84d3-cccf-4946-8a76-7c7cae5983de","Type":"ContainerStarted","Data":"4b9bf15e3bd8be81c2bf38a0d780c3a983fc96d52eb5559d3f516678f508d763"}
Sep 08 15:45:27.577258 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:27.577186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6h9df" event={"ID":"7d2949f2-6be5-4492-a713-0a9a3e1b851b","Type":"ContainerStarted","Data":"a0a424779d6957f1a4cab788057a5b8a2676deb716e6e7537e5d96a57e2a5ebc"}
Sep 08 15:45:29.584553 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.584509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-89ltc" event={"ID":"b9c9745d-ab52-4f00-a408-0441edbdf049","Type":"ContainerStarted","Data":"10aaf99277a075dfa654c2eb3dfd916999f73e5f4a24dcda9d44a490a8f90e15"}
Sep 08 15:45:29.585047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.584615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:29.585047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.584643    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-89ltc" event={"ID":"b9c9745d-ab52-4f00-a408-0441edbdf049","Type":"ContainerStarted","Data":"a521c566ba1e92f681fe6de8a9f6a682fcd07148d9080f1776da6869b3511ae8"}
Sep 08 15:45:29.586188 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.586166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n" event={"ID":"a82a84d3-cccf-4946-8a76-7c7cae5983de","Type":"ContainerStarted","Data":"3438af355cb5e42908d5c6d5071dc79d0cb6a8b94436210d2c54e73bbbd69eea"}
Sep 08 15:45:29.586289 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.586265    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n"
Sep 08 15:45:29.587852 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.587816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kkv8k" event={"ID":"e5242e48-8452-44ce-99c0-d72cf7485389","Type":"ContainerStarted","Data":"f0a6ddfc4dea5c5e7b06f9e359d2f9d300b4eba117ae7cbfd75d6d749b4a338f"}
Sep 08 15:45:29.590095 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.590071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6h9df" event={"ID":"7d2949f2-6be5-4492-a713-0a9a3e1b851b","Type":"ContainerStarted","Data":"50bf38d50ab8160b3aeae29da530799133f6f36bf6df99e2fc80ad9bcb6211ac"}
Sep 08 15:45:29.591897 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.591879    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n"
Sep 08 15:45:29.603872 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.603802    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-89ltc" podStartSLOduration=1.426770418 podStartE2EDuration="4.603788871s" totalImagesPullingTime="3.177018453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:29.6034268 +0000 UTC m=+57.725582415" watchObservedRunningTime="2026-09-08 15:45:29.603788871 +0000 UTC m=+57.725944485"
Sep 08 15:45:29.622613 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.622564    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6h9df" podStartSLOduration=1.516279401 podStartE2EDuration="4.622548235s" totalImagesPullingTime="3.106268834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:45:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:29.62186139 +0000 UTC m=+57.744017012" watchObservedRunningTime="2026-09-08 15:45:29.622548235 +0000 UTC m=+57.744703842"
Sep 08 15:45:29.637934 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.637886    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-2ls7n" podStartSLOduration=1.60480308 podStartE2EDuration="3.637870488s" totalImagesPullingTime="2.033067408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:29.636779269 +0000 UTC m=+57.758934883" watchObservedRunningTime="2026-09-08 15:45:29.637870488 +0000 UTC m=+57.760026103"
Sep 08 15:45:29.655667 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.655616    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kkv8k" podStartSLOduration=1.397661076 podStartE2EDuration="4.655599854s" totalImagesPullingTime="3.257938778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:29.654763263 +0000 UTC m=+57.776918880" watchObservedRunningTime="2026-09-08 15:45:29.655599854 +0000 UTC m=+57.777755469"
Sep 08 15:45:29.742613 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.742561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:29.810266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:29.810218    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:30.398210 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:30.398168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:30.464288 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:30.464227    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:30.538275 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:30.538237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:30.940614 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:30.940554    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:33.501898 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:33.501870    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt496"
Sep 08 15:45:33.660074 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:33.660037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:33.731186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:33.731150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:35.590603 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:35.590562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:35.695293 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:35.695256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:35.815458 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:35.815426    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:37.708287 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.708254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:37.937497 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.937464    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-64cjp"]
Sep 08 15:45:37.945071 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.945040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:37.947876 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.947843    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 15:45:37.947876 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.947877    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 15:45:37.948091 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.947991    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nkrhj\""
Sep 08 15:45:37.948410 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.948389    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 15:45:37.948410 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.948408    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 15:45:37.948569 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.948454    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 15:45:37.948569 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.948504    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 15:45:37.967004 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:37.966919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:38.030513 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.030468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.030513 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.030514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-tls\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.030786 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.030553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-wtmp\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.030786 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.030593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.030786 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.030640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k89wl\" (UniqueName: \"kubernetes.io/projected/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-kube-api-access-k89wl\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.030786 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.030670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:38.030786 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.030696    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-sys\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.030786 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.030742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-textfile\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.030786 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.030774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-root\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.031076 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.030807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-metrics-client-ca\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.033422 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.033401    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 15:45:38.043472 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.043439    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec19266e-6f33-48f8-a4fd-f09a750a0e57-original-pull-secret\") pod \"global-pull-secret-syncer-q5jph\" (UID: \"ec19266e-6f33-48f8-a4fd-f09a750a0e57\") " pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:38.065267 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.065234    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:38.131513 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-wtmp\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.131672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.131672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:38.131672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k89wl\" (UniqueName: \"kubernetes.io/projected/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-kube-api-access-k89wl\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.131672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-sys\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.131672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-textfile\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.131672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-root\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.131672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-metrics-client-ca\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.132043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.132043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131694    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-wtmp\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.132043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-tls\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.132043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-sys\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.132043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.131756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-root\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.132043 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:38.131784    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 08 15:45:38.132043 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:38.131884    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-tls podName:e1abe2c1-acce-4f8c-887d-d3475e3f76c4 nodeName:}" failed. No retries permitted until 2026-09-08 15:45:38.631865581 +0000 UTC m=+66.754021186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-tls") pod "node-exporter-64cjp" (UID: "e1abe2c1-acce-4f8c-887d-d3475e3f76c4") : secret "node-exporter-tls" not found
Sep 08 15:45:38.132043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.132038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-textfile\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.132451 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.132234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.132451 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.132399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-metrics-client-ca\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.134057 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.134028    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.134186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.134167    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 15:45:38.141953 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.141925    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k89wl\" (UniqueName: \"kubernetes.io/projected/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-kube-api-access-k89wl\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.143831 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.143793    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f248c91-519f-4278-a822-ed12fcee59d0-metrics-certs\") pod \"network-metrics-daemon-tk7z8\" (UID: \"7f248c91-519f-4278-a822-ed12fcee59d0\") " pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:38.165495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.165448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:38.232190 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.232106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjs8\" (UniqueName: \"kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8\") pod \"network-check-target-zfd8g\" (UID: \"8b206d20-85f6-4f51-a10c-dff318621c06\") " pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:38.234666 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.234641    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 15:45:38.244892 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.244865    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 15:45:38.255070 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.255040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpjs8\" (UniqueName: \"kubernetes.io/projected/8b206d20-85f6-4f51-a10c-dff318621c06-kube-api-access-lpjs8\") pod \"network-check-target-zfd8g\" (UID: \"8b206d20-85f6-4f51-a10c-dff318621c06\") " pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:38.265131 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.265102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:38.271315 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.271295    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xkdlq\""
Sep 08 15:45:38.274352 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.274335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5jph"
Sep 08 15:45:38.279064 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.279036    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:38.359127 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.359097    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:38.375095 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.375063    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78hmt\""
Sep 08 15:45:38.383106 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.383077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk7z8"
Sep 08 15:45:38.545091 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.545018    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q5jph"]
Sep 08 15:45:38.547919 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:38.547891    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec19266e_6f33_48f8_a4fd_f09a750a0e57.slice/crio-87a081bd9e664e201d3164baec22329c8a6853bb20f087ec8a1021bf59d2c2b9 WatchSource:0}: Error finding container 87a081bd9e664e201d3164baec22329c8a6853bb20f087ec8a1021bf59d2c2b9: Status 404 returned error can't find the container with id 87a081bd9e664e201d3164baec22329c8a6853bb20f087ec8a1021bf59d2c2b9
Sep 08 15:45:38.552545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.552521    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zfd8g"]
Sep 08 15:45:38.555629 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:38.555607    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b206d20_85f6_4f51_a10c_dff318621c06.slice/crio-8e2a50c13d0e393b50421fe3d44143da5e79cbc825e69c369cc676951cbf5da2 WatchSource:0}: Error finding container 8e2a50c13d0e393b50421fe3d44143da5e79cbc825e69c369cc676951cbf5da2: Status 404 returned error can't find the container with id 8e2a50c13d0e393b50421fe3d44143da5e79cbc825e69c369cc676951cbf5da2
Sep 08 15:45:38.610221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.610183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:38.621463 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.621429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zfd8g" event={"ID":"8b206d20-85f6-4f51-a10c-dff318621c06","Type":"ContainerStarted","Data":"8e2a50c13d0e393b50421fe3d44143da5e79cbc825e69c369cc676951cbf5da2"}
Sep 08 15:45:38.622523 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.622501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q5jph" event={"ID":"ec19266e-6f33-48f8-a4fd-f09a750a0e57","Type":"ContainerStarted","Data":"87a081bd9e664e201d3164baec22329c8a6853bb20f087ec8a1021bf59d2c2b9"}
Sep 08 15:45:38.636115 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.636082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-tls\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.638542 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.638506    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1abe2c1-acce-4f8c-887d-d3475e3f76c4-node-exporter-tls\") pod \"node-exporter-64cjp\" (UID: \"e1abe2c1-acce-4f8c-887d-d3475e3f76c4\") " pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.655684 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.655645    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tk7z8"]
Sep 08 15:45:38.658449 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:38.658417    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f248c91_519f_4278_a822_ed12fcee59d0.slice/crio-ab81174eb815e73ea6863506ff7c2dcd9450d5b6e9b7981918051390f8476304 WatchSource:0}: Error finding container ab81174eb815e73ea6863506ff7c2dcd9450d5b6e9b7981918051390f8476304: Status 404 returned error can't find the container with id ab81174eb815e73ea6863506ff7c2dcd9450d5b6e9b7981918051390f8476304
Sep 08 15:45:38.716164 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.716129    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:38.854090 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.853977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-64cjp"
Sep 08 15:45:38.866194 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:38.866153    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1abe2c1_acce_4f8c_887d_d3475e3f76c4.slice/crio-d63bff18d399da1481ee4aeca4033c407365fee45f89cb4bd03d24683da03853 WatchSource:0}: Error finding container d63bff18d399da1481ee4aeca4033c407365fee45f89cb4bd03d24683da03853: Status 404 returned error can't find the container with id d63bff18d399da1481ee4aeca4033c407365fee45f89cb4bd03d24683da03853
Sep 08 15:45:38.946218 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:38.946171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:39.064199 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.064166    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:45:39.064807 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.064764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:39.069236 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.069214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.071557 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.071527    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 15:45:39.071750 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.071737    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 15:45:39.071800 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.071784    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 15:45:39.071800 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.071794    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 15:45:39.072081 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.072067    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 15:45:39.072241 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.072224    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-48fk2\""
Sep 08 15:45:39.072241 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.072234    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 15:45:39.072347 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.072318    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 15:45:39.072420 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.072403    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 15:45:39.072519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.072505    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 15:45:39.089418 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.089384    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:45:39.140200 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140200 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140200 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140190    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-config-volume\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140352    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-web-config\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tslf\" (UniqueName: \"kubernetes.io/projected/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-kube-api-access-4tslf\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-config-out\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.140989 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.140502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.155374 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.155340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-web-config\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tslf\" (UniqueName: \"kubernetes.io/projected/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-kube-api-access-4tslf\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-config-out\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.242109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.241582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-config-volume\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.243183 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.243152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.243975 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:39.243410    2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 08 15:45:39.243975 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:39.243488    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-main-tls podName:c52d4eb8-5064-4c04-8d52-dbc9aa9752c7 nodeName:}" failed. No retries permitted until 2026-09-08 15:45:39.743466484 +0000 UTC m=+67.865622091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c52d4eb8-5064-4c04-8d52-dbc9aa9752c7") : secret "alertmanager-main-tls" not found
Sep 08 15:45:39.243975 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.243492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.244207 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.244119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.247087 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.247053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.248617 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.248588    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.249167 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.249119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-web-config\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.249992 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.249946    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-config-out\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.250566 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.250098    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.250566 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.250529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-config-volume\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.253084 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.253058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.253701 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.253666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.256974 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.256919    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tslf\" (UniqueName: \"kubernetes.io/projected/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-kube-api-access-4tslf\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.436983 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.436952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:39.596397 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.595652    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-89ltc"
Sep 08 15:45:39.640844 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.635473    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tk7z8" event={"ID":"7f248c91-519f-4278-a822-ed12fcee59d0","Type":"ContainerStarted","Data":"ab81174eb815e73ea6863506ff7c2dcd9450d5b6e9b7981918051390f8476304"}
Sep 08 15:45:39.640844 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.638417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64cjp" event={"ID":"e1abe2c1-acce-4f8c-887d-d3475e3f76c4","Type":"ContainerStarted","Data":"d63bff18d399da1481ee4aeca4033c407365fee45f89cb4bd03d24683da03853"}
Sep 08 15:45:39.747231 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.747139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.750637 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.750604    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c52d4eb8-5064-4c04-8d52-dbc9aa9752c7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:39.979221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:39.979155    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:45:40.420036 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:40.420013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:45:40.421917 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:40.421884    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52d4eb8_5064_4c04_8d52_dbc9aa9752c7.slice/crio-636cffc76f26fb1c8a34da2870c879cb40d847631905069d14ebb3faf268819c WatchSource:0}: Error finding container 636cffc76f26fb1c8a34da2870c879cb40d847631905069d14ebb3faf268819c: Status 404 returned error can't find the container with id 636cffc76f26fb1c8a34da2870c879cb40d847631905069d14ebb3faf268819c
Sep 08 15:45:40.643797 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:40.643706    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1abe2c1-acce-4f8c-887d-d3475e3f76c4" containerID="bfa179b3950d175e6275ec03fdeb9c1d6a0bc9b669a2da0df600adbfdd1a30c2" exitCode=0
Sep 08 15:45:40.643983 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:40.643800    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64cjp" event={"ID":"e1abe2c1-acce-4f8c-887d-d3475e3f76c4","Type":"ContainerDied","Data":"bfa179b3950d175e6275ec03fdeb9c1d6a0bc9b669a2da0df600adbfdd1a30c2"}
Sep 08 15:45:40.645801 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:40.645753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tk7z8" event={"ID":"7f248c91-519f-4278-a822-ed12fcee59d0","Type":"ContainerStarted","Data":"7dac54eb204b3be2ee1b8b6dcad374f4bdfc59becf81ff1772e4cb0843797d02"}
Sep 08 15:45:40.645952 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:40.645837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tk7z8" event={"ID":"7f248c91-519f-4278-a822-ed12fcee59d0","Type":"ContainerStarted","Data":"45354e6d36a605ab7421b8487d185deb51a5ea63feda1a25c17a1dbab868d0ad"}
Sep 08 15:45:40.647367 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:40.647335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7","Type":"ContainerStarted","Data":"636cffc76f26fb1c8a34da2870c879cb40d847631905069d14ebb3faf268819c"}
Sep 08 15:45:40.677084 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:40.677018    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tk7z8" podStartSLOduration=67.208968802 podStartE2EDuration="1m8.676993963s" totalImagesPullingTime="1.468025161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:40.676272366 +0000 UTC m=+68.798427993" watchObservedRunningTime="2026-09-08 15:45:40.676993963 +0000 UTC m=+68.799149578"
Sep 08 15:45:40.856132 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:40.856048    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:40.967066 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:40.967027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:41.054632 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:41.054577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:41.193581 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:41.193541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:41.293925 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:41.293809    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:41.654497 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:41.654458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64cjp" event={"ID":"e1abe2c1-acce-4f8c-887d-d3475e3f76c4","Type":"ContainerStarted","Data":"899422e612bfe462b4e67a193ebc125bbb80ac7dbc0d99d4d84506d218d5af5a"}
Sep 08 15:45:41.654661 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:41.654530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64cjp" event={"ID":"e1abe2c1-acce-4f8c-887d-d3475e3f76c4","Type":"ContainerStarted","Data":"8b2bf0a3ec39cb96285274428e4541c4c8d8a71a446f75c7b284603837d86c71"}
Sep 08 15:45:41.675250 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:41.675185    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-64cjp" podStartSLOduration=3.3261086779999998 podStartE2EDuration="4.675163848s" totalImagesPullingTime="1.262477754s" totalInitContainerRuntime="86.577416ms" isStatefulPod=true podCreationTimestamp="2026-09-08 15:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:41.674285979 +0000 UTC m=+69.796441598" watchObservedRunningTime="2026-09-08 15:45:41.675163848 +0000 UTC m=+69.797319464"
Sep 08 15:45:42.411482 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.411448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:42.469562 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.469519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:42.670777 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.670669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:42.683560 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.683525    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"]
Sep 08 15:45:42.706811 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.706777    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"]
Sep 08 15:45:42.706988 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.706886    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:42.709370 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.709333    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xcbdl\""
Sep 08 15:45:42.709370 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.709359    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 15:45:42.770322 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.770274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lg8k\" (UniqueName: \"kubernetes.io/projected/a43a9f40-b6b1-4129-99cf-512a49d89f18-kube-api-access-8lg8k\") pod \"monitoring-plugin-85bbbbbf4-9jh7m\" (UID: \"a43a9f40-b6b1-4129-99cf-512a49d89f18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:42.770496 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.770408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a43a9f40-b6b1-4129-99cf-512a49d89f18-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9jh7m\" (UID: \"a43a9f40-b6b1-4129-99cf-512a49d89f18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:42.771429 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.771399    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:42.871212 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.871169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lg8k\" (UniqueName: \"kubernetes.io/projected/a43a9f40-b6b1-4129-99cf-512a49d89f18-kube-api-access-8lg8k\") pod \"monitoring-plugin-85bbbbbf4-9jh7m\" (UID: \"a43a9f40-b6b1-4129-99cf-512a49d89f18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:42.871392 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.871257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a43a9f40-b6b1-4129-99cf-512a49d89f18-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9jh7m\" (UID: \"a43a9f40-b6b1-4129-99cf-512a49d89f18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:42.871392 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:42.871369    2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 08 15:45:42.871502 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:45:42.871428    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a43a9f40-b6b1-4129-99cf-512a49d89f18-monitoring-plugin-cert podName:a43a9f40-b6b1-4129-99cf-512a49d89f18 nodeName:}" failed. No retries permitted until 2026-09-08 15:45:43.37140726 +0000 UTC m=+71.493562853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a43a9f40-b6b1-4129-99cf-512a49d89f18-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-9jh7m" (UID: "a43a9f40-b6b1-4129-99cf-512a49d89f18") : secret "monitoring-plugin-cert" not found
Sep 08 15:45:42.882154 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:42.882117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lg8k\" (UniqueName: \"kubernetes.io/projected/a43a9f40-b6b1-4129-99cf-512a49d89f18-kube-api-access-8lg8k\") pod \"monitoring-plugin-85bbbbbf4-9jh7m\" (UID: \"a43a9f40-b6b1-4129-99cf-512a49d89f18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:43.018531 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.018438    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:43.134227 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.134192    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-878599bf-bjzww"]
Sep 08 15:45:43.152772 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.152657    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.153331 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.153014    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-878599bf-bjzww"]
Sep 08 15:45:43.155811 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.155037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sft4z\""
Sep 08 15:45:43.155811 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.155046    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 15:45:43.155811 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.155342    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 15:45:43.155811 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.155658    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 15:45:43.156209 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.156185    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 15:45:43.156209 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.156208    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 15:45:43.160769 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.160710    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 15:45:43.174107 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.174062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9297b984-89e9-49e4-ac85-fbf0aecf71fd-serving-certs-ca-bundle\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.174268 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.174131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9297b984-89e9-49e4-ac85-fbf0aecf71fd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.174268 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.174186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8b8g\" (UniqueName: \"kubernetes.io/projected/9297b984-89e9-49e4-ac85-fbf0aecf71fd-kube-api-access-c8b8g\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.174268 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.174243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-federate-client-tls\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.174445 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.174359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.174445 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.174406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-secret-telemeter-client\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.174535 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.174472    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-telemeter-client-tls\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.174535 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.174507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9297b984-89e9-49e4-ac85-fbf0aecf71fd-metrics-client-ca\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.275188 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.275091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8b8g\" (UniqueName: \"kubernetes.io/projected/9297b984-89e9-49e4-ac85-fbf0aecf71fd-kube-api-access-c8b8g\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.275188 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.275147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-federate-client-tls\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.275426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.275202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.275426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.275239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-secret-telemeter-client\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.275426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.275272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-telemeter-client-tls\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.275426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.275305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9297b984-89e9-49e4-ac85-fbf0aecf71fd-metrics-client-ca\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.275426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.275355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9297b984-89e9-49e4-ac85-fbf0aecf71fd-serving-certs-ca-bundle\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.275426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.275394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9297b984-89e9-49e4-ac85-fbf0aecf71fd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.276260 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.276217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9297b984-89e9-49e4-ac85-fbf0aecf71fd-serving-certs-ca-bundle\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.276396 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.276265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9297b984-89e9-49e4-ac85-fbf0aecf71fd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.276396 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.276388    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9297b984-89e9-49e4-ac85-fbf0aecf71fd-metrics-client-ca\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.278442 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.278421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-telemeter-client-tls\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.278442 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.278427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.278603 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.278438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-secret-telemeter-client\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.278603 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.278516    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9297b984-89e9-49e4-ac85-fbf0aecf71fd-federate-client-tls\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.283129 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.283106    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8b8g\" (UniqueName: \"kubernetes.io/projected/9297b984-89e9-49e4-ac85-fbf0aecf71fd-kube-api-access-c8b8g\") pod \"telemeter-client-878599bf-bjzww\" (UID: \"9297b984-89e9-49e4-ac85-fbf0aecf71fd\") " pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.376230 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.376188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a43a9f40-b6b1-4129-99cf-512a49d89f18-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9jh7m\" (UID: \"a43a9f40-b6b1-4129-99cf-512a49d89f18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:43.379019 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.378986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a43a9f40-b6b1-4129-99cf-512a49d89f18-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9jh7m\" (UID: \"a43a9f40-b6b1-4129-99cf-512a49d89f18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:43.467745 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.467707    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-878599bf-bjzww"
Sep 08 15:45:43.517038 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.517001    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:43.574866 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.574769    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-664f56b8f8-qxt2w"]
Sep 08 15:45:43.576886 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.576866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.581725 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.581702    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 15:45:43.582412 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.582388    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 15:45:43.582412 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.582389    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 15:45:43.584170 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.584143    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 15:45:43.584296 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.584184    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 15:45:43.589039 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.589015    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 15:45:43.589164 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.589038    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 15:45:43.589164 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.589124    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p89kc\""
Sep 08 15:45:43.590039 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.590017    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 15:45:43.599636 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.599604    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664f56b8f8-qxt2w"]
Sep 08 15:45:43.617145 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.617101    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:43.652991 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.652958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:43.678394 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.678356    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-service-ca\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.678622 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.678404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-console-config\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.678622 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.678437    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnrbs\" (UniqueName: \"kubernetes.io/projected/2080f01a-8782-4845-b481-a221c514838a-kube-api-access-tnrbs\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.678622 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.678493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-trusted-ca-bundle\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.678622 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.678575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-oauth-config\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.678622 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.678613    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-serving-cert\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.678949 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.678650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-oauth-serving-cert\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.779832 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.779782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-serving-cert\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.780094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.779843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-oauth-serving-cert\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.780094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.779891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-service-ca\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.780094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.779912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-console-config\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.780094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.779929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnrbs\" (UniqueName: \"kubernetes.io/projected/2080f01a-8782-4845-b481-a221c514838a-kube-api-access-tnrbs\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.780094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.779948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-trusted-ca-bundle\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.780094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.779986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-oauth-config\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.780796 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.780767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-console-config\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.780927 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.780874    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-oauth-serving-cert\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.781255 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.781237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-service-ca\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.781493 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.781471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-trusted-ca-bundle\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.782552 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.782513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-serving-cert\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.782552 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.782527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-oauth-config\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.791142 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.791116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnrbs\" (UniqueName: \"kubernetes.io/projected/2080f01a-8782-4845-b481-a221c514838a-kube-api-access-tnrbs\") pod \"console-664f56b8f8-qxt2w\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") " pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:43.888658 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:43.888572    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:44.245488 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.245450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:44.333175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.333138    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-878599bf-bjzww"]
Sep 08 15:45:44.335332 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.335304    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"]
Sep 08 15:45:44.338095 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:44.337660    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9297b984_89e9_49e4_ac85_fbf0aecf71fd.slice/crio-6169d47a14d92b4128107fac16f5d547451391078eedf941b12d6e88964a8eb4 WatchSource:0}: Error finding container 6169d47a14d92b4128107fac16f5d547451391078eedf941b12d6e88964a8eb4: Status 404 returned error can't find the container with id 6169d47a14d92b4128107fac16f5d547451391078eedf941b12d6e88964a8eb4
Sep 08 15:45:44.338490 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.338466    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664f56b8f8-qxt2w"]
Sep 08 15:45:44.340933 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:44.340905    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43a9f40_b6b1_4129_99cf_512a49d89f18.slice/crio-f3715aacbc8142bab2244244dd3aec649fd236bcf94189217dbfb918a791bc30 WatchSource:0}: Error finding container f3715aacbc8142bab2244244dd3aec649fd236bcf94189217dbfb918a791bc30: Status 404 returned error can't find the container with id f3715aacbc8142bab2244244dd3aec649fd236bcf94189217dbfb918a791bc30
Sep 08 15:45:44.342515 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:45:44.342479    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2080f01a_8782_4845_b481_a221c514838a.slice/crio-03ee7bac1265d8a97ac312357a3651eaa8cee8b42b4a5c287428620560d49063 WatchSource:0}: Error finding container 03ee7bac1265d8a97ac312357a3651eaa8cee8b42b4a5c287428620560d49063: Status 404 returned error can't find the container with id 03ee7bac1265d8a97ac312357a3651eaa8cee8b42b4a5c287428620560d49063
Sep 08 15:45:44.666366 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.666326    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-878599bf-bjzww" event={"ID":"9297b984-89e9-49e4-ac85-fbf0aecf71fd","Type":"ContainerStarted","Data":"6169d47a14d92b4128107fac16f5d547451391078eedf941b12d6e88964a8eb4"}
Sep 08 15:45:44.667958 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.667930    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zfd8g" event={"ID":"8b206d20-85f6-4f51-a10c-dff318621c06","Type":"ContainerStarted","Data":"69ef4130d96c576c4968c4a9255c8d47acb66f7f065b66a76b6a2cb9b6e6ffef"}
Sep 08 15:45:44.668074 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.668057    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:45:44.669557 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.669526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q5jph" event={"ID":"ec19266e-6f33-48f8-a4fd-f09a750a0e57","Type":"ContainerStarted","Data":"6f27ee233d78831dd6cbb8ee79474f357fab018a42ca50dd8ef9629c1e6e9dbe"}
Sep 08 15:45:44.671117 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.671093    2581 generic.go:356] "Generic (PLEG): container finished" podID="c52d4eb8-5064-4c04-8d52-dbc9aa9752c7" containerID="347c662223c64bf8d5200ebf226dabbce43d13a7ad4d526f0f482ce3f83ce0b5" exitCode=0
Sep 08 15:45:44.671218 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.671168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7","Type":"ContainerDied","Data":"347c662223c64bf8d5200ebf226dabbce43d13a7ad4d526f0f482ce3f83ce0b5"}
Sep 08 15:45:44.672515 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.672491    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664f56b8f8-qxt2w" event={"ID":"2080f01a-8782-4845-b481-a221c514838a","Type":"ContainerStarted","Data":"03ee7bac1265d8a97ac312357a3651eaa8cee8b42b4a5c287428620560d49063"}
Sep 08 15:45:44.673604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.673582    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m" event={"ID":"a43a9f40-b6b1-4129-99cf-512a49d89f18","Type":"ContainerStarted","Data":"f3715aacbc8142bab2244244dd3aec649fd236bcf94189217dbfb918a791bc30"}
Sep 08 15:45:44.683190 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.683136    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zfd8g" podStartSLOduration=67.191714073 podStartE2EDuration="1m12.683121258s" totalImagesPullingTime="5.491407185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:44.682596827 +0000 UTC m=+72.804752442" watchObservedRunningTime="2026-09-08 15:45:44.683121258 +0000 UTC m=+72.805276873"
Sep 08 15:45:44.728951 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:44.728896    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q5jph" podStartSLOduration=67.210482659 podStartE2EDuration="1m12.728875754s" totalImagesPullingTime="5.518393095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:44.728051506 +0000 UTC m=+72.850207163" watchObservedRunningTime="2026-09-08 15:45:44.728875754 +0000 UTC m=+72.851031368"
Sep 08 15:45:45.527447 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:45.527378    2581 patch_prober.go:28] interesting pod/image-registry-7db6ffdfbf-4wzpm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 08 15:45:45.527644 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:45.527446    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm" podUID="9f48b7c4-3a57-4c95-8401-b9d62b4bdf42" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:45:46.274503 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:46.274465    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:46.685569 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:46.685528    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m" event={"ID":"a43a9f40-b6b1-4129-99cf-512a49d89f18","Type":"ContainerStarted","Data":"e2012b1ccb8e0a6461ca81fea46602037ded5f3173d195b6579b9c478f8d5b36"}
Sep 08 15:45:46.685754 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:46.685735    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:46.687971 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:46.687938    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-878599bf-bjzww" event={"ID":"9297b984-89e9-49e4-ac85-fbf0aecf71fd","Type":"ContainerStarted","Data":"e2d2c954032861317b24f013235583eed87129ac27c283f6b2944d9586803505"}
Sep 08 15:45:46.688091 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:46.688011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-878599bf-bjzww" event={"ID":"9297b984-89e9-49e4-ac85-fbf0aecf71fd","Type":"ContainerStarted","Data":"3d292bad711dbaa25f778d1d0c064f77f99a36889629ac8ed57fc19c1f429239"}
Sep 08 15:45:46.688091 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:46.688048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-878599bf-bjzww" event={"ID":"9297b984-89e9-49e4-ac85-fbf0aecf71fd","Type":"ContainerStarted","Data":"0de555a35b33cbe23024a0f631dc3fb1059160d89a9793020aa95c1073af9254"}
Sep 08 15:45:46.690930 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:46.690908    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m"
Sep 08 15:45:46.701315 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:46.701265    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9jh7m" podStartSLOduration=3.230516219 podStartE2EDuration="4.701248684s" totalImagesPullingTime="1.470732465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:46.700558087 +0000 UTC m=+74.822713706" watchObservedRunningTime="2026-09-08 15:45:46.701248684 +0000 UTC m=+74.823404298"
Sep 08 15:45:46.719041 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:46.718989    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-878599bf-bjzww" podStartSLOduration=1.6741589380000002 podStartE2EDuration="3.718973813s" totalImagesPullingTime="2.044814875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:46.718088472 +0000 UTC m=+74.840244091" watchObservedRunningTime="2026-09-08 15:45:46.718973813 +0000 UTC m=+74.841129453"
Sep 08 15:45:47.583463 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:47.583431    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7db6ffdfbf-4wzpm"
Sep 08 15:45:47.603782 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:47.603745    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:47.696882 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:47.696816    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664f56b8f8-qxt2w"]
Sep 08 15:45:47.799617 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:47.799576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:48.014956 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:48.014915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:49.280387 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.280357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:49.381027 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.380994    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:49.482641 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.482608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:49.583635 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.583595    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:49.704652 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.704617    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7","Type":"ContainerStarted","Data":"9e72e7f791f45a7c52f91e3f43f0b3c18206b677ea8876faff929a6f4662b828"}
Sep 08 15:45:49.704854 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.704726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7","Type":"ContainerStarted","Data":"8ded99c4b4a6564c8ffaa6c03f634857c8d49c016f4009a1fa5bb545d745232c"}
Sep 08 15:45:49.704854 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.704755    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7","Type":"ContainerStarted","Data":"f3bcb49f617015cf124a247518abe34087950c1cf4de895ab7ff968e2997c0c4"}
Sep 08 15:45:49.704854 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.704779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7","Type":"ContainerStarted","Data":"93bd7958baa301d638af7a1bde225c75f44be6b0eb1621213f2c68644c8fe207"}
Sep 08 15:45:49.704854 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.704804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7","Type":"ContainerStarted","Data":"679ec3a03b842e895d3a5375ec23b92892651006e651ca92a492352bd639cad8"}
Sep 08 15:45:49.706166 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.706141    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664f56b8f8-qxt2w" event={"ID":"2080f01a-8782-4845-b481-a221c514838a","Type":"ContainerStarted","Data":"31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9"}
Sep 08 15:45:49.724189 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:49.724133    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-664f56b8f8-qxt2w" podStartSLOduration=1.716795775 podStartE2EDuration="6.724115074s" totalImagesPullingTime="5.007319299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:49.723148953 +0000 UTC m=+77.845304568" watchObservedRunningTime="2026-09-08 15:45:49.724115074 +0000 UTC m=+77.846270689"
Sep 08 15:45:50.346933 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:50.346897    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:50.447252 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:50.447205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:50.713502 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:50.713466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c52d4eb8-5064-4c04-8d52-dbc9aa9752c7","Type":"ContainerStarted","Data":"b43ecda612c7ade39d05992cf80cfde8eaa5e347e660902094e7c62ef76b0d38"}
Sep 08 15:45:50.740775 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:50.740714    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6735712830000002 podStartE2EDuration="11.740695345s" totalImagesPullingTime="9.046796969s" totalInitContainerRuntime="20.327093ms" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:50.739407911 +0000 UTC m=+78.861563529" watchObservedRunningTime="2026-09-08 15:45:50.740695345 +0000 UTC m=+78.862850960"
Sep 08 15:45:52.160438 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:52.160402    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:52.257303 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:52.257261    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:53.888902 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:53.888857    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:45:54.904768 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:54.904730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:55.009189 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:55.009150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:56.483990 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:56.483953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:58.479264 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:58.479230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:58.598590 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:58.598551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:58.770787 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:58.770683    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:58.874462 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:58.874429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:59.066588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:59.066504    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:59.549926 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:59.549867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:59.652282 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:59.652249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:59.761929 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:45:59.761896    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:12.403352 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:12.403319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:12.503296 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:12.503268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:14.726008 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:14.725964    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-664f56b8f8-qxt2w" podUID="2080f01a-8782-4845-b481-a221c514838a" containerName="console" containerID="cri-o://31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9" gracePeriod=15
Sep 08 15:46:14.995882 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:14.995794    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:46:15.140629 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.140594    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-oauth-serving-cert\") pod \"2080f01a-8782-4845-b481-a221c514838a\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") "
Sep 08 15:46:15.140869 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.140641    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnrbs\" (UniqueName: \"kubernetes.io/projected/2080f01a-8782-4845-b481-a221c514838a-kube-api-access-tnrbs\") pod \"2080f01a-8782-4845-b481-a221c514838a\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") "
Sep 08 15:46:15.140869 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.140673    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-trusted-ca-bundle\") pod \"2080f01a-8782-4845-b481-a221c514838a\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") "
Sep 08 15:46:15.140869 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.140704    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-service-ca\") pod \"2080f01a-8782-4845-b481-a221c514838a\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") "
Sep 08 15:46:15.140869 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.140720    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-console-config\") pod \"2080f01a-8782-4845-b481-a221c514838a\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") "
Sep 08 15:46:15.140869 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.140742    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-oauth-config\") pod \"2080f01a-8782-4845-b481-a221c514838a\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") "
Sep 08 15:46:15.140869 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.140812    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-serving-cert\") pod \"2080f01a-8782-4845-b481-a221c514838a\" (UID: \"2080f01a-8782-4845-b481-a221c514838a\") "
Sep 08 15:46:15.141396 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.141365    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2080f01a-8782-4845-b481-a221c514838a" (UID: "2080f01a-8782-4845-b481-a221c514838a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:46:15.141396 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.141372    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2080f01a-8782-4845-b481-a221c514838a" (UID: "2080f01a-8782-4845-b481-a221c514838a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:46:15.141396 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.141381    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-console-config" (OuterVolumeSpecName: "console-config") pod "2080f01a-8782-4845-b481-a221c514838a" (UID: "2080f01a-8782-4845-b481-a221c514838a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:46:15.141590 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.141388    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-service-ca" (OuterVolumeSpecName: "service-ca") pod "2080f01a-8782-4845-b481-a221c514838a" (UID: "2080f01a-8782-4845-b481-a221c514838a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:46:15.143314 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.143290    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2080f01a-8782-4845-b481-a221c514838a" (UID: "2080f01a-8782-4845-b481-a221c514838a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:46:15.143314 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.143289    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2080f01a-8782-4845-b481-a221c514838a-kube-api-access-tnrbs" (OuterVolumeSpecName: "kube-api-access-tnrbs") pod "2080f01a-8782-4845-b481-a221c514838a" (UID: "2080f01a-8782-4845-b481-a221c514838a"). InnerVolumeSpecName "kube-api-access-tnrbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:46:15.143435 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.143363    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2080f01a-8782-4845-b481-a221c514838a" (UID: "2080f01a-8782-4845-b481-a221c514838a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:46:15.242155 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.242117    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-trusted-ca-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:46:15.242155 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.242148    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:46:15.242155 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.242158    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-console-config\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:46:15.242155 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.242165    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-oauth-config\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:46:15.242416 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.242175    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2080f01a-8782-4845-b481-a221c514838a-console-serving-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:46:15.242416 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.242185    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2080f01a-8782-4845-b481-a221c514838a-oauth-serving-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:46:15.242416 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.242193    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnrbs\" (UniqueName: \"kubernetes.io/projected/2080f01a-8782-4845-b481-a221c514838a-kube-api-access-tnrbs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:46:15.680832 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.680796    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zfd8g"
Sep 08 15:46:15.808050 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.808017    2581 generic.go:356] "Generic (PLEG): container finished" podID="2080f01a-8782-4845-b481-a221c514838a" containerID="31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9" exitCode=0
Sep 08 15:46:15.808460 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.808064    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664f56b8f8-qxt2w"
Sep 08 15:46:15.808460 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.808090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664f56b8f8-qxt2w" event={"ID":"2080f01a-8782-4845-b481-a221c514838a","Type":"ContainerDied","Data":"31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9"}
Sep 08 15:46:15.808460 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.808137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664f56b8f8-qxt2w" event={"ID":"2080f01a-8782-4845-b481-a221c514838a","Type":"ContainerDied","Data":"03ee7bac1265d8a97ac312357a3651eaa8cee8b42b4a5c287428620560d49063"}
Sep 08 15:46:15.808460 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.808159    2581 scope.go:117] "RemoveContainer" containerID="31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9"
Sep 08 15:46:15.825595 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.825535    2581 scope.go:117] "RemoveContainer" containerID="31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9"
Sep 08 15:46:15.826000 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:46:15.825965    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9\": container with ID starting with 31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9 not found: ID does not exist" containerID="31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9"
Sep 08 15:46:15.826107 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.826011    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9"} err="failed to get container status \"31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9\": rpc error: code = NotFound desc = could not find container \"31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9\": container with ID starting with 31ed77886f6fc68c3c45e39305dd640b19d81804ea1606811d6e03f0217d9ae9 not found: ID does not exist"
Sep 08 15:46:15.827398 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.827374    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664f56b8f8-qxt2w"]
Sep 08 15:46:15.833221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:15.833199    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-664f56b8f8-qxt2w"]
Sep 08 15:46:16.366033 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:16.365618    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2080f01a-8782-4845-b481-a221c514838a" path="/var/lib/kubelet/pods/2080f01a-8782-4845-b481-a221c514838a/volumes"
Sep 08 15:46:23.398387 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:23.398351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:23.522325 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:23.522291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:25.244965 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.244923    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-965dbc75-rt8x8"]
Sep 08 15:46:25.245356 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.245203    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2080f01a-8782-4845-b481-a221c514838a" containerName="console"
Sep 08 15:46:25.245356 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.245218    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2080f01a-8782-4845-b481-a221c514838a" containerName="console"
Sep 08 15:46:25.245356 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.245281    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2080f01a-8782-4845-b481-a221c514838a" containerName="console"
Sep 08 15:46:25.250152 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.250132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.252436 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.252412    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 15:46:25.252591 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.252565    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 15:46:25.252666 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.252634    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p89kc\""
Sep 08 15:46:25.252666 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.252574    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 15:46:25.252776 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.252654    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 15:46:25.252776 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.252706    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 15:46:25.252894 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.252785    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 15:46:25.252984 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.252969    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 15:46:25.258436 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.258410    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 15:46:25.258610 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.258571    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-965dbc75-rt8x8"]
Sep 08 15:46:25.291587 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.291548    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:25.341015 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.340984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:25.421667 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.421632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-trusted-ca-bundle\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.421853 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.421675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbpqq\" (UniqueName: \"kubernetes.io/projected/3d303933-aabb-4316-b057-3aff11ad6425-kube-api-access-kbpqq\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.421853 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.421699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-service-ca\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.421853 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.421796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-oauth-config\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.421853 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.421844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-oauth-serving-cert\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.421983 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.421871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-serving-cert\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.421983 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.421887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-console-config\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.522351 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.522249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-oauth-serving-cert\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.522351 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.522304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-serving-cert\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.522351 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.522331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-console-config\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.522623 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.522424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-trusted-ca-bundle\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.522623 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.522453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbpqq\" (UniqueName: \"kubernetes.io/projected/3d303933-aabb-4316-b057-3aff11ad6425-kube-api-access-kbpqq\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.522623 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.522481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-service-ca\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.522623 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.522528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-oauth-config\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.523152 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.523124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-oauth-serving-cert\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.523386 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.523357    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-console-config\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.523475 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.523390    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-trusted-ca-bundle\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.523475 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.523440    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-service-ca\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.524957 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.524935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-serving-cert\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.525093 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.525077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-oauth-config\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.529705 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.529681    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbpqq\" (UniqueName: \"kubernetes.io/projected/3d303933-aabb-4316-b057-3aff11ad6425-kube-api-access-kbpqq\") pod \"console-965dbc75-rt8x8\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") " pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.561102 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.561051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:25.832633 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.832558    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-965dbc75-rt8x8"]
Sep 08 15:46:25.836585 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:46:25.836557    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d303933_aabb_4316_b057_3aff11ad6425.slice/crio-4ac908c3c0e76e22d1a9dea005c1063e6282848cc81a90a01addd9d1e23b10b6 WatchSource:0}: Error finding container 4ac908c3c0e76e22d1a9dea005c1063e6282848cc81a90a01addd9d1e23b10b6: Status 404 returned error can't find the container with id 4ac908c3c0e76e22d1a9dea005c1063e6282848cc81a90a01addd9d1e23b10b6
Sep 08 15:46:25.847649 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:25.847622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-965dbc75-rt8x8" event={"ID":"3d303933-aabb-4316-b057-3aff11ad6425","Type":"ContainerStarted","Data":"4ac908c3c0e76e22d1a9dea005c1063e6282848cc81a90a01addd9d1e23b10b6"}
Sep 08 15:46:26.852428 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:26.852385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-965dbc75-rt8x8" event={"ID":"3d303933-aabb-4316-b057-3aff11ad6425","Type":"ContainerStarted","Data":"3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254"}
Sep 08 15:46:26.871098 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:26.871042    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-965dbc75-rt8x8" podStartSLOduration=1.871024969 podStartE2EDuration="1.871024969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:46:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:46:26.869587608 +0000 UTC m=+114.991743223" watchObservedRunningTime="2026-09-08 15:46:26.871024969 +0000 UTC m=+114.993180584"
Sep 08 15:46:35.561432 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:35.561386    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:35.562039 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:35.561451    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:35.566178 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:35.566154    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:35.890296 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:35.890206    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:46:36.113114 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:36.113076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:36.212398 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:36.212372    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:38.554945 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:38.554913    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:38.616158 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:38.616130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:42.431727 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:42.431689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:42.532745 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:42.532710    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:59.777728 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:46:59.777686    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:32.107714 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.107679    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:32.175005 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.174974    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:32.645217 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.645176    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"]
Sep 08 15:47:32.647879 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.647861    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:32.650037 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.650008    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:47:32.650147 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.650008    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:47:32.650669 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.650649    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-twlpl\""
Sep 08 15:47:32.656703 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.656679    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"]
Sep 08 15:47:32.761469 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.761423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2fqg\" (UniqueName: \"kubernetes.io/projected/8a493e27-a777-4595-9e1e-b5e41fb28990-kube-api-access-p2fqg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:32.761469 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.761474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:32.761703 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.761505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:32.862353 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.862320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2fqg\" (UniqueName: \"kubernetes.io/projected/8a493e27-a777-4595-9e1e-b5e41fb28990-kube-api-access-p2fqg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:32.862456 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.862364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:32.862456 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.862391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:32.862747 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.862724    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:32.862747 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.862743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:32.870097 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.870058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2fqg\" (UniqueName: \"kubernetes.io/projected/8a493e27-a777-4595-9e1e-b5e41fb28990-kube-api-access-p2fqg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:32.958118 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:32.958074    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:33.227515 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:33.227425    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"]
Sep 08 15:47:33.230272 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:47:33.230243    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a493e27_a777_4595_9e1e_b5e41fb28990.slice/crio-e867200cc585bcc3411e33e837dad23a6b69066c19e130996eb0388951bcfd52 WatchSource:0}: Error finding container e867200cc585bcc3411e33e837dad23a6b69066c19e130996eb0388951bcfd52: Status 404 returned error can't find the container with id e867200cc585bcc3411e33e837dad23a6b69066c19e130996eb0388951bcfd52
Sep 08 15:47:34.090121 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:34.090086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt" event={"ID":"8a493e27-a777-4595-9e1e-b5e41fb28990","Type":"ContainerStarted","Data":"e867200cc585bcc3411e33e837dad23a6b69066c19e130996eb0388951bcfd52"}
Sep 08 15:47:40.114917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:40.114868    2581 generic.go:356] "Generic (PLEG): container finished" podID="8a493e27-a777-4595-9e1e-b5e41fb28990" containerID="736be1fd2c0b4826edc15dd978829830cdec43efe0e7a7c525be1da2f1b6d0ad" exitCode=0
Sep 08 15:47:40.115307 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:40.114952    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt" event={"ID":"8a493e27-a777-4595-9e1e-b5e41fb28990","Type":"ContainerDied","Data":"736be1fd2c0b4826edc15dd978829830cdec43efe0e7a7c525be1da2f1b6d0ad"}
Sep 08 15:47:43.127558 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:43.127524    2581 generic.go:356] "Generic (PLEG): container finished" podID="8a493e27-a777-4595-9e1e-b5e41fb28990" containerID="ca3ab536789d87419f8f63bb9f5f258213d2a2433d045366ab713e324c2b51f6" exitCode=0
Sep 08 15:47:43.128025 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:43.127604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt" event={"ID":"8a493e27-a777-4595-9e1e-b5e41fb28990","Type":"ContainerDied","Data":"ca3ab536789d87419f8f63bb9f5f258213d2a2433d045366ab713e324c2b51f6"}
Sep 08 15:47:47.232483 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:47.232437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:49.482292 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:49.482248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:49.583605 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:49.583558    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:51.161734 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:51.161692    2581 generic.go:356] "Generic (PLEG): container finished" podID="8a493e27-a777-4595-9e1e-b5e41fb28990" containerID="4e6af43dd1617c75466ab10146a5ea9994248097fbae33cf450977fff6178283" exitCode=0
Sep 08 15:47:51.162124 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:51.161786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt" event={"ID":"8a493e27-a777-4595-9e1e-b5e41fb28990","Type":"ContainerDied","Data":"4e6af43dd1617c75466ab10146a5ea9994248097fbae33cf450977fff6178283"}
Sep 08 15:47:52.285666 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:52.285641    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:52.431214 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:52.431116    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2fqg\" (UniqueName: \"kubernetes.io/projected/8a493e27-a777-4595-9e1e-b5e41fb28990-kube-api-access-p2fqg\") pod \"8a493e27-a777-4595-9e1e-b5e41fb28990\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") "
Sep 08 15:47:52.431214 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:52.431184    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-util\") pod \"8a493e27-a777-4595-9e1e-b5e41fb28990\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") "
Sep 08 15:47:52.431214 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:52.431202    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-bundle\") pod \"8a493e27-a777-4595-9e1e-b5e41fb28990\" (UID: \"8a493e27-a777-4595-9e1e-b5e41fb28990\") "
Sep 08 15:47:52.431946 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:52.431920    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-bundle" (OuterVolumeSpecName: "bundle") pod "8a493e27-a777-4595-9e1e-b5e41fb28990" (UID: "8a493e27-a777-4595-9e1e-b5e41fb28990"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:52.433435 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:52.433410    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a493e27-a777-4595-9e1e-b5e41fb28990-kube-api-access-p2fqg" (OuterVolumeSpecName: "kube-api-access-p2fqg") pod "8a493e27-a777-4595-9e1e-b5e41fb28990" (UID: "8a493e27-a777-4595-9e1e-b5e41fb28990"). InnerVolumeSpecName "kube-api-access-p2fqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:47:52.435587 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:52.435560    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-util" (OuterVolumeSpecName: "util") pod "8a493e27-a777-4595-9e1e-b5e41fb28990" (UID: "8a493e27-a777-4595-9e1e-b5e41fb28990"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:52.532746 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:52.532699    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2fqg\" (UniqueName: \"kubernetes.io/projected/8a493e27-a777-4595-9e1e-b5e41fb28990-kube-api-access-p2fqg\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:47:52.532746 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:52.532738    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:47:52.532746 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:52.532751    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a493e27-a777-4595-9e1e-b5e41fb28990-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:47:53.171016 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:53.170980    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt"
Sep 08 15:47:53.171178 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:53.170984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpbdt" event={"ID":"8a493e27-a777-4595-9e1e-b5e41fb28990","Type":"ContainerDied","Data":"e867200cc585bcc3411e33e837dad23a6b69066c19e130996eb0388951bcfd52"}
Sep 08 15:47:53.171178 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:53.171101    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e867200cc585bcc3411e33e837dad23a6b69066c19e130996eb0388951bcfd52"
Sep 08 15:47:58.687216 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:58.687168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:59.514926 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:47:59.514892    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:00.595001 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.594970    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"]
Sep 08 15:48:00.595420 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.595235    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a493e27-a777-4595-9e1e-b5e41fb28990" containerName="util"
Sep 08 15:48:00.595420 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.595246    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a493e27-a777-4595-9e1e-b5e41fb28990" containerName="util"
Sep 08 15:48:00.595420 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.595267    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a493e27-a777-4595-9e1e-b5e41fb28990" containerName="extract"
Sep 08 15:48:00.595420 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.595273    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a493e27-a777-4595-9e1e-b5e41fb28990" containerName="extract"
Sep 08 15:48:00.595420 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.595284    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a493e27-a777-4595-9e1e-b5e41fb28990" containerName="pull"
Sep 08 15:48:00.595420 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.595289    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a493e27-a777-4595-9e1e-b5e41fb28990" containerName="pull"
Sep 08 15:48:00.595420 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.595332    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a493e27-a777-4595-9e1e-b5e41fb28990" containerName="extract"
Sep 08 15:48:00.598240 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.598222    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"
Sep 08 15:48:00.603065 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.603036    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 15:48:00.603335 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.603307    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tpkxb\""
Sep 08 15:48:00.603550 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.603535    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:48:00.611272 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.611239    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"]
Sep 08 15:48:00.694051 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.694016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksfwq\" (UniqueName: \"kubernetes.io/projected/e9003d56-15c7-443f-93c3-e9e71039c63e-kube-api-access-ksfwq\") pod \"cert-manager-operator-controller-manager-55c444bf86-p7chg\" (UID: \"e9003d56-15c7-443f-93c3-e9e71039c63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"
Sep 08 15:48:00.694051 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.694056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9003d56-15c7-443f-93c3-e9e71039c63e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-p7chg\" (UID: \"e9003d56-15c7-443f-93c3-e9e71039c63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"
Sep 08 15:48:00.795281 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.795215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9003d56-15c7-443f-93c3-e9e71039c63e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-p7chg\" (UID: \"e9003d56-15c7-443f-93c3-e9e71039c63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"
Sep 08 15:48:00.795460 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.795341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksfwq\" (UniqueName: \"kubernetes.io/projected/e9003d56-15c7-443f-93c3-e9e71039c63e-kube-api-access-ksfwq\") pod \"cert-manager-operator-controller-manager-55c444bf86-p7chg\" (UID: \"e9003d56-15c7-443f-93c3-e9e71039c63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"
Sep 08 15:48:00.795711 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.795686    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9003d56-15c7-443f-93c3-e9e71039c63e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-p7chg\" (UID: \"e9003d56-15c7-443f-93c3-e9e71039c63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"
Sep 08 15:48:00.804308 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.804276    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksfwq\" (UniqueName: \"kubernetes.io/projected/e9003d56-15c7-443f-93c3-e9e71039c63e-kube-api-access-ksfwq\") pod \"cert-manager-operator-controller-manager-55c444bf86-p7chg\" (UID: \"e9003d56-15c7-443f-93c3-e9e71039c63e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"
Sep 08 15:48:00.907551 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:00.907517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"
Sep 08 15:48:01.188812 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:01.188728    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg"]
Sep 08 15:48:01.192422 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:48:01.192391    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9003d56_15c7_443f_93c3_e9e71039c63e.slice/crio-cc7a321e51c0c6a6164df221485129ef38442a7ec0a98d8e9eaefe678959dbbf WatchSource:0}: Error finding container cc7a321e51c0c6a6164df221485129ef38442a7ec0a98d8e9eaefe678959dbbf: Status 404 returned error can't find the container with id cc7a321e51c0c6a6164df221485129ef38442a7ec0a98d8e9eaefe678959dbbf
Sep 08 15:48:01.202063 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:01.202024    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg" event={"ID":"e9003d56-15c7-443f-93c3-e9e71039c63e","Type":"ContainerStarted","Data":"cc7a321e51c0c6a6164df221485129ef38442a7ec0a98d8e9eaefe678959dbbf"}
Sep 08 15:48:02.355879 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:02.355836    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:02.456510 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:02.456477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:03.212588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:03.212552    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg" event={"ID":"e9003d56-15c7-443f-93c3-e9e71039c63e","Type":"ContainerStarted","Data":"fbd8e873c4fcaa287d6c2b7235d94c3f39bf6d2aa6d6e329ca97ede4095e2ccd"}
Sep 08 15:48:03.238715 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:03.238651    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p7chg" podStartSLOduration=1.407294887 podStartE2EDuration="3.238626069s" totalImagesPullingTime="1.831331182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:48:03.236950544 +0000 UTC m=+211.359106158" watchObservedRunningTime="2026-09-08 15:48:03.238626069 +0000 UTC m=+211.360781684"
Sep 08 15:48:03.591679 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:03.591644    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:03.726707 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:03.726675    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:04.112999 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.112965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:04.213862 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.213803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:04.533247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.533211    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"]
Sep 08 15:48:04.536351 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.536333    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:04.540373 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.540344    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-twlpl\""
Sep 08 15:48:04.540505 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.540422    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:48:04.540505 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.540348    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:48:04.549602 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.549572    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"]
Sep 08 15:48:04.631049 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.631008    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s49bt\" (UniqueName: \"kubernetes.io/projected/91e9e006-9111-4a7f-ac2a-3ffdba163afb-kube-api-access-s49bt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:04.631455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.631129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:04.631455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.631172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:04.731727 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.731671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:04.731727 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.731729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:04.732015 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.731759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49bt\" (UniqueName: \"kubernetes.io/projected/91e9e006-9111-4a7f-ac2a-3ffdba163afb-kube-api-access-s49bt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:04.732100 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.732080    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:04.732190 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.732168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:04.750988 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.750960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s49bt\" (UniqueName: \"kubernetes.io/projected/91e9e006-9111-4a7f-ac2a-3ffdba163afb-kube-api-access-s49bt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:04.845766 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:04.845656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:05.117552 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:05.117505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"]
Sep 08 15:48:05.120216 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:48:05.120189    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e9e006_9111_4a7f_ac2a_3ffdba163afb.slice/crio-caedeebd2c9d904e977d21c115657ebf2711038a5578c28b76623ac58b25e598 WatchSource:0}: Error finding container caedeebd2c9d904e977d21c115657ebf2711038a5578c28b76623ac58b25e598: Status 404 returned error can't find the container with id caedeebd2c9d904e977d21c115657ebf2711038a5578c28b76623ac58b25e598
Sep 08 15:48:05.227669 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:05.227635    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2" event={"ID":"91e9e006-9111-4a7f-ac2a-3ffdba163afb","Type":"ContainerStarted","Data":"dc5084526f228543e65139ea24cae5b4cd592afa5f1141d6db89928250d06578"}
Sep 08 15:48:05.227807 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:05.227714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2" event={"ID":"91e9e006-9111-4a7f-ac2a-3ffdba163afb","Type":"ContainerStarted","Data":"caedeebd2c9d904e977d21c115657ebf2711038a5578c28b76623ac58b25e598"}
Sep 08 15:48:06.233450 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.233413    2581 generic.go:356] "Generic (PLEG): container finished" podID="91e9e006-9111-4a7f-ac2a-3ffdba163afb" containerID="dc5084526f228543e65139ea24cae5b4cd592afa5f1141d6db89928250d06578" exitCode=0
Sep 08 15:48:06.233799 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.233490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2" event={"ID":"91e9e006-9111-4a7f-ac2a-3ffdba163afb","Type":"ContainerDied","Data":"dc5084526f228543e65139ea24cae5b4cd592afa5f1141d6db89928250d06578"}
Sep 08 15:48:06.247570 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.247534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:06.450544 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.450508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:06.812518 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.812475    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"]
Sep 08 15:48:06.815692 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.815673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"
Sep 08 15:48:06.818041 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.818009    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 15:48:06.818291 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.818270    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mfn9f\""
Sep 08 15:48:06.818400 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.818381    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 15:48:06.827121 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.827091    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"]
Sep 08 15:48:06.950461 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.950425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e8266cd-c639-466e-a261-828ac004187d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s4xnx\" (UID: \"3e8266cd-c639-466e-a261-828ac004187d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"
Sep 08 15:48:06.950630 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:06.950467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc697\" (UniqueName: \"kubernetes.io/projected/3e8266cd-c639-466e-a261-828ac004187d-kube-api-access-fc697\") pod \"cert-manager-cainjector-559cdd8c87-s4xnx\" (UID: \"3e8266cd-c639-466e-a261-828ac004187d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"
Sep 08 15:48:07.051316 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:07.051259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e8266cd-c639-466e-a261-828ac004187d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s4xnx\" (UID: \"3e8266cd-c639-466e-a261-828ac004187d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"
Sep 08 15:48:07.051514 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:07.051326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc697\" (UniqueName: \"kubernetes.io/projected/3e8266cd-c639-466e-a261-828ac004187d-kube-api-access-fc697\") pod \"cert-manager-cainjector-559cdd8c87-s4xnx\" (UID: \"3e8266cd-c639-466e-a261-828ac004187d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"
Sep 08 15:48:07.059949 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:07.059912    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e8266cd-c639-466e-a261-828ac004187d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s4xnx\" (UID: \"3e8266cd-c639-466e-a261-828ac004187d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"
Sep 08 15:48:07.060114 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:07.059971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc697\" (UniqueName: \"kubernetes.io/projected/3e8266cd-c639-466e-a261-828ac004187d-kube-api-access-fc697\") pod \"cert-manager-cainjector-559cdd8c87-s4xnx\" (UID: \"3e8266cd-c639-466e-a261-828ac004187d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"
Sep 08 15:48:07.132410 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:07.132331    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"
Sep 08 15:48:07.416034 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:07.415998    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx"]
Sep 08 15:48:07.420711 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:48:07.420672    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e8266cd_c639_466e_a261_828ac004187d.slice/crio-76973b3d11d3c8edfc317f67cc3cbe12e1e7efb2bdcd1f28bc7ac04b14225862 WatchSource:0}: Error finding container 76973b3d11d3c8edfc317f67cc3cbe12e1e7efb2bdcd1f28bc7ac04b14225862: Status 404 returned error can't find the container with id 76973b3d11d3c8edfc317f67cc3cbe12e1e7efb2bdcd1f28bc7ac04b14225862
Sep 08 15:48:08.245851 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:08.245798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx" event={"ID":"3e8266cd-c639-466e-a261-828ac004187d","Type":"ContainerStarted","Data":"76973b3d11d3c8edfc317f67cc3cbe12e1e7efb2bdcd1f28bc7ac04b14225862"}
Sep 08 15:48:09.094728 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:09.094684    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:09.195675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:09.195639    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:09.254362 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:09.254325    2581 generic.go:356] "Generic (PLEG): container finished" podID="91e9e006-9111-4a7f-ac2a-3ffdba163afb" containerID="dff9c39c8c43d7d1dddccde05f98c9118ce6f7acb2232d618cbf23e338d573b8" exitCode=0
Sep 08 15:48:09.254516 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:09.254381    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2" event={"ID":"91e9e006-9111-4a7f-ac2a-3ffdba163afb","Type":"ContainerDied","Data":"dff9c39c8c43d7d1dddccde05f98c9118ce6f7acb2232d618cbf23e338d573b8"}
Sep 08 15:48:10.262586 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:10.262542    2581 generic.go:356] "Generic (PLEG): container finished" podID="91e9e006-9111-4a7f-ac2a-3ffdba163afb" containerID="0ce32f611ed3aa81622b7b1e5af7326a5d267ef0205ececa786046f8c56a15c6" exitCode=0
Sep 08 15:48:10.263030 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:10.262594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2" event={"ID":"91e9e006-9111-4a7f-ac2a-3ffdba163afb","Type":"ContainerDied","Data":"0ce32f611ed3aa81622b7b1e5af7326a5d267ef0205ececa786046f8c56a15c6"}
Sep 08 15:48:11.412624 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.412582    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rbtm9"]
Sep 08 15:48:11.421620 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.421591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9"
Sep 08 15:48:11.424285 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.424246    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6msqr\""
Sep 08 15:48:11.425878 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.425847    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rbtm9"]
Sep 08 15:48:11.591450 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.591357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjsmj\" (UniqueName: \"kubernetes.io/projected/36daa187-1d4d-482e-81da-7889fa76c280-kube-api-access-gjsmj\") pod \"cert-manager-webhook-6486ffd997-rbtm9\" (UID: \"36daa187-1d4d-482e-81da-7889fa76c280\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9"
Sep 08 15:48:11.591450 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.591404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36daa187-1d4d-482e-81da-7889fa76c280-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rbtm9\" (UID: \"36daa187-1d4d-482e-81da-7889fa76c280\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9"
Sep 08 15:48:11.637695 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.637664    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:11.692777 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.692736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjsmj\" (UniqueName: \"kubernetes.io/projected/36daa187-1d4d-482e-81da-7889fa76c280-kube-api-access-gjsmj\") pod \"cert-manager-webhook-6486ffd997-rbtm9\" (UID: \"36daa187-1d4d-482e-81da-7889fa76c280\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9"
Sep 08 15:48:11.692777 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.692780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36daa187-1d4d-482e-81da-7889fa76c280-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rbtm9\" (UID: \"36daa187-1d4d-482e-81da-7889fa76c280\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9"
Sep 08 15:48:11.700888 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.700855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36daa187-1d4d-482e-81da-7889fa76c280-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rbtm9\" (UID: \"36daa187-1d4d-482e-81da-7889fa76c280\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9"
Sep 08 15:48:11.701039 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.700918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjsmj\" (UniqueName: \"kubernetes.io/projected/36daa187-1d4d-482e-81da-7889fa76c280-kube-api-access-gjsmj\") pod \"cert-manager-webhook-6486ffd997-rbtm9\" (UID: \"36daa187-1d4d-482e-81da-7889fa76c280\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9"
Sep 08 15:48:11.733545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.733504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9"
Sep 08 15:48:11.794098 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.794065    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s49bt\" (UniqueName: \"kubernetes.io/projected/91e9e006-9111-4a7f-ac2a-3ffdba163afb-kube-api-access-s49bt\") pod \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") "
Sep 08 15:48:11.794290 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.794112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-bundle\") pod \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") "
Sep 08 15:48:11.794290 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.794140    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-util\") pod \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\" (UID: \"91e9e006-9111-4a7f-ac2a-3ffdba163afb\") "
Sep 08 15:48:11.794506 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.794481    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-bundle" (OuterVolumeSpecName: "bundle") pod "91e9e006-9111-4a7f-ac2a-3ffdba163afb" (UID: "91e9e006-9111-4a7f-ac2a-3ffdba163afb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:11.796241 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.796213    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e9e006-9111-4a7f-ac2a-3ffdba163afb-kube-api-access-s49bt" (OuterVolumeSpecName: "kube-api-access-s49bt") pod "91e9e006-9111-4a7f-ac2a-3ffdba163afb" (UID: "91e9e006-9111-4a7f-ac2a-3ffdba163afb"). InnerVolumeSpecName "kube-api-access-s49bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:48:11.798706 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.798653    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-util" (OuterVolumeSpecName: "util") pod "91e9e006-9111-4a7f-ac2a-3ffdba163afb" (UID: "91e9e006-9111-4a7f-ac2a-3ffdba163afb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:11.895424 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.895332    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:48:11.895424 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.895367    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s49bt\" (UniqueName: \"kubernetes.io/projected/91e9e006-9111-4a7f-ac2a-3ffdba163afb-kube-api-access-s49bt\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:48:11.895424 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:11.895379    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e9e006-9111-4a7f-ac2a-3ffdba163afb-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:48:12.267526 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:12.267496    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rbtm9"]
Sep 08 15:48:12.270236 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:48:12.270205    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36daa187_1d4d_482e_81da_7889fa76c280.slice/crio-fb4fbaf32eba209efd8dd133a4ceb43029e22d30de95df4af1dd9ce3002290f3 WatchSource:0}: Error finding container fb4fbaf32eba209efd8dd133a4ceb43029e22d30de95df4af1dd9ce3002290f3: Status 404 returned error can't find the container with id fb4fbaf32eba209efd8dd133a4ceb43029e22d30de95df4af1dd9ce3002290f3
Sep 08 15:48:12.274039 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:12.274014    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2"
Sep 08 15:48:12.274039 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:12.274020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fblfr2" event={"ID":"91e9e006-9111-4a7f-ac2a-3ffdba163afb","Type":"ContainerDied","Data":"caedeebd2c9d904e977d21c115657ebf2711038a5578c28b76623ac58b25e598"}
Sep 08 15:48:12.274205 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:12.274085    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="caedeebd2c9d904e977d21c115657ebf2711038a5578c28b76623ac58b25e598"
Sep 08 15:48:12.276507 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:12.276483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx" event={"ID":"3e8266cd-c639-466e-a261-828ac004187d","Type":"ContainerStarted","Data":"f4a8142166d717a5b11a2a3b8d737b96061de95eb514ddb4645bbebbd2851b60"}
Sep 08 15:48:12.299495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:12.299449    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s4xnx" podStartSLOduration=1.719051707 podStartE2EDuration="6.299433398s" totalImagesPullingTime="4.580381691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:48:12.297635746 +0000 UTC m=+220.419791362" watchObservedRunningTime="2026-09-08 15:48:12.299433398 +0000 UTC m=+220.421589013"
Sep 08 15:48:12.825157 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:12.825095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:12.883421 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:12.883386    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:12.945998 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:12.945951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:13.282009 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:13.281973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9" event={"ID":"36daa187-1d4d-482e-81da-7889fa76c280","Type":"ContainerStarted","Data":"567fd225682bf6f723910b9e40ea0e6e04384c3a4beded01af4ec3ae2bfa21e7"}
Sep 08 15:48:13.282009 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:13.282015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9" event={"ID":"36daa187-1d4d-482e-81da-7889fa76c280","Type":"ContainerStarted","Data":"fb4fbaf32eba209efd8dd133a4ceb43029e22d30de95df4af1dd9ce3002290f3"}
Sep 08 15:48:13.282225 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:13.282056    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9"
Sep 08 15:48:13.298379 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:13.298330    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9" podStartSLOduration=2.298313117 podStartE2EDuration="2.298313117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:48:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:48:13.296772988 +0000 UTC m=+221.418928603" watchObservedRunningTime="2026-09-08 15:48:13.298313117 +0000 UTC m=+221.420468732"
Sep 08 15:48:13.845651 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:13.845612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:16.571284 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:16.571245    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:16.669901 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:16.669866    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:19.288666 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:19.288633    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rbtm9"
Sep 08 15:48:22.720253 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:22.720220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:22.820359 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:22.820307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:24.317980 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.317941    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"]
Sep 08 15:48:24.318355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.318242    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e9e006-9111-4a7f-ac2a-3ffdba163afb" containerName="pull"
Sep 08 15:48:24.318355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.318253    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e9e006-9111-4a7f-ac2a-3ffdba163afb" containerName="pull"
Sep 08 15:48:24.318355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.318270    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e9e006-9111-4a7f-ac2a-3ffdba163afb" containerName="extract"
Sep 08 15:48:24.318355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.318275    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e9e006-9111-4a7f-ac2a-3ffdba163afb" containerName="extract"
Sep 08 15:48:24.318355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.318288    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e9e006-9111-4a7f-ac2a-3ffdba163afb" containerName="util"
Sep 08 15:48:24.318355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.318293    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e9e006-9111-4a7f-ac2a-3ffdba163afb" containerName="util"
Sep 08 15:48:24.318355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.318335    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e9e006-9111-4a7f-ac2a-3ffdba163afb" containerName="extract"
Sep 08 15:48:24.334300 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.334270    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"]
Sep 08 15:48:24.334449 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.334390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.336599 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.336566    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:48:24.336763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.336603    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:48:24.337394 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.337369    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-twlpl\""
Sep 08 15:48:24.378838 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.378788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.379012 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.378878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.379012 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.378907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qgxh\" (UniqueName: \"kubernetes.io/projected/c2b568fe-e2bd-4b50-921e-6d5e545be532-kube-api-access-7qgxh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.480216 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.480180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.480216 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.480216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.480409 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.480245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qgxh\" (UniqueName: \"kubernetes.io/projected/c2b568fe-e2bd-4b50-921e-6d5e545be532-kube-api-access-7qgxh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.480588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.480569    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.480681 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.480655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.488504 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.488464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qgxh\" (UniqueName: \"kubernetes.io/projected/c2b568fe-e2bd-4b50-921e-6d5e545be532-kube-api-access-7qgxh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.602071 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.601978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:24.644538 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.644497    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:24.934058 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:24.934026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"]
Sep 08 15:48:24.936605 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:48:24.936568    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b568fe_e2bd_4b50_921e_6d5e545be532.slice/crio-1d9d230a21a239676242ce5ae8991f0a4dfc2dedd64fe4d88a8b576415198b96 WatchSource:0}: Error finding container 1d9d230a21a239676242ce5ae8991f0a4dfc2dedd64fe4d88a8b576415198b96: Status 404 returned error can't find the container with id 1d9d230a21a239676242ce5ae8991f0a4dfc2dedd64fe4d88a8b576415198b96
Sep 08 15:48:25.333082 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:25.332990    2581 generic.go:356] "Generic (PLEG): container finished" podID="c2b568fe-e2bd-4b50-921e-6d5e545be532" containerID="a6c98893844be807bcbb6cb57cca7c1913a643af0aaf7db6fc3e50266f8e036d" exitCode=0
Sep 08 15:48:25.333082 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:25.333034    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt" event={"ID":"c2b568fe-e2bd-4b50-921e-6d5e545be532","Type":"ContainerDied","Data":"a6c98893844be807bcbb6cb57cca7c1913a643af0aaf7db6fc3e50266f8e036d"}
Sep 08 15:48:25.333476 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:25.333082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt" event={"ID":"c2b568fe-e2bd-4b50-921e-6d5e545be532","Type":"ContainerStarted","Data":"1d9d230a21a239676242ce5ae8991f0a4dfc2dedd64fe4d88a8b576415198b96"}
Sep 08 15:48:28.346994 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:28.346961    2581 generic.go:356] "Generic (PLEG): container finished" podID="c2b568fe-e2bd-4b50-921e-6d5e545be532" containerID="a0e9709f54aa5dd91813dcf3c3c5a2084f6ecc1ca680415a81940b2b4868636e" exitCode=0
Sep 08 15:48:28.347435 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:28.347006    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt" event={"ID":"c2b568fe-e2bd-4b50-921e-6d5e545be532","Type":"ContainerDied","Data":"a0e9709f54aa5dd91813dcf3c3c5a2084f6ecc1ca680415a81940b2b4868636e"}
Sep 08 15:48:29.353934 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:29.353895    2581 generic.go:356] "Generic (PLEG): container finished" podID="c2b568fe-e2bd-4b50-921e-6d5e545be532" containerID="25aa55d0a10fdf7b88439cb6d251b839acad2c189804e12163b31341a1b97eeb" exitCode=0
Sep 08 15:48:29.354347 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:29.353984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt" event={"ID":"c2b568fe-e2bd-4b50-921e-6d5e545be532","Type":"ContainerDied","Data":"25aa55d0a10fdf7b88439cb6d251b839acad2c189804e12163b31341a1b97eeb"}
Sep 08 15:48:30.486932 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:30.486905    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:30.529124 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:30.529097    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qgxh\" (UniqueName: \"kubernetes.io/projected/c2b568fe-e2bd-4b50-921e-6d5e545be532-kube-api-access-7qgxh\") pod \"c2b568fe-e2bd-4b50-921e-6d5e545be532\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") "
Sep 08 15:48:30.529303 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:30.529177    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-bundle\") pod \"c2b568fe-e2bd-4b50-921e-6d5e545be532\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") "
Sep 08 15:48:30.529303 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:30.529198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-util\") pod \"c2b568fe-e2bd-4b50-921e-6d5e545be532\" (UID: \"c2b568fe-e2bd-4b50-921e-6d5e545be532\") "
Sep 08 15:48:30.529964 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:30.529923    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-bundle" (OuterVolumeSpecName: "bundle") pod "c2b568fe-e2bd-4b50-921e-6d5e545be532" (UID: "c2b568fe-e2bd-4b50-921e-6d5e545be532"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:30.531220 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:30.531197    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b568fe-e2bd-4b50-921e-6d5e545be532-kube-api-access-7qgxh" (OuterVolumeSpecName: "kube-api-access-7qgxh") pod "c2b568fe-e2bd-4b50-921e-6d5e545be532" (UID: "c2b568fe-e2bd-4b50-921e-6d5e545be532"). InnerVolumeSpecName "kube-api-access-7qgxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:48:30.533726 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:30.533706    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-util" (OuterVolumeSpecName: "util") pod "c2b568fe-e2bd-4b50-921e-6d5e545be532" (UID: "c2b568fe-e2bd-4b50-921e-6d5e545be532"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:30.630640 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:30.630535    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:48:30.630640 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:30.630578    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b568fe-e2bd-4b50-921e-6d5e545be532-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:48:30.630640 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:30.630591    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qgxh\" (UniqueName: \"kubernetes.io/projected/c2b568fe-e2bd-4b50-921e-6d5e545be532-kube-api-access-7qgxh\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:48:31.364333 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:31.364300    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt"
Sep 08 15:48:31.364333 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:31.364318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs7hdt" event={"ID":"c2b568fe-e2bd-4b50-921e-6d5e545be532","Type":"ContainerDied","Data":"1d9d230a21a239676242ce5ae8991f0a4dfc2dedd64fe4d88a8b576415198b96"}
Sep 08 15:48:31.364535 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:31.364372    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d9d230a21a239676242ce5ae8991f0a4dfc2dedd64fe4d88a8b576415198b96"
Sep 08 15:48:40.344847 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:40.344788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:41.265550 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.265507    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"]
Sep 08 15:48:41.265864 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.265851    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b568fe-e2bd-4b50-921e-6d5e545be532" containerName="extract"
Sep 08 15:48:41.265916 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.265865    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b568fe-e2bd-4b50-921e-6d5e545be532" containerName="extract"
Sep 08 15:48:41.265916 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.265879    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b568fe-e2bd-4b50-921e-6d5e545be532" containerName="pull"
Sep 08 15:48:41.265916 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.265884    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b568fe-e2bd-4b50-921e-6d5e545be532" containerName="pull"
Sep 08 15:48:41.265916 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.265893    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b568fe-e2bd-4b50-921e-6d5e545be532" containerName="util"
Sep 08 15:48:41.265916 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.265898    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b568fe-e2bd-4b50-921e-6d5e545be532" containerName="util"
Sep 08 15:48:41.266062 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.265943    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b568fe-e2bd-4b50-921e-6d5e545be532" containerName="extract"
Sep 08 15:48:41.268515 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.268495    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.270693 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.270663    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 15:48:41.270900 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.270767    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 15:48:41.271084 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.271066    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 15:48:41.271870 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.271852    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-89p79\""
Sep 08 15:48:41.271964 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.271880    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 15:48:41.288510 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.288470    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"]
Sep 08 15:48:41.309955 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.309908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm4tr\" (UniqueName: \"kubernetes.io/projected/eeb46ad6-dc65-47cc-a6e6-495613684200-kube-api-access-nm4tr\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.310156 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.309966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eeb46ad6-dc65-47cc-a6e6-495613684200-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.310156 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.310061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eeb46ad6-dc65-47cc-a6e6-495613684200-manifests\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.310156 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.310097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eeb46ad6-dc65-47cc-a6e6-495613684200-tmp\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.310156 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.310123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeb46ad6-dc65-47cc-a6e6-495613684200-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.411309 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.411264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eeb46ad6-dc65-47cc-a6e6-495613684200-manifests\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.411309 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.411308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eeb46ad6-dc65-47cc-a6e6-495613684200-tmp\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.411871 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.411333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeb46ad6-dc65-47cc-a6e6-495613684200-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.411871 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.411370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm4tr\" (UniqueName: \"kubernetes.io/projected/eeb46ad6-dc65-47cc-a6e6-495613684200-kube-api-access-nm4tr\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.411871 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.411416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eeb46ad6-dc65-47cc-a6e6-495613684200-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.411871 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.411742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eeb46ad6-dc65-47cc-a6e6-495613684200-manifests\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.413915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.413887    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eeb46ad6-dc65-47cc-a6e6-495613684200-tmp\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.414028 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.413941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeb46ad6-dc65-47cc-a6e6-495613684200-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.414118 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.414097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eeb46ad6-dc65-47cc-a6e6-495613684200-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.426354 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.426323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm4tr\" (UniqueName: \"kubernetes.io/projected/eeb46ad6-dc65-47cc-a6e6-495613684200-kube-api-access-nm4tr\") pod \"opendatahub-operator-controller-manager-5d4b5866d6-s57fx\" (UID: \"eeb46ad6-dc65-47cc-a6e6-495613684200\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.533349 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.533246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:41.580273 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.580230    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:41.632200 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.632165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:41.733959 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.733922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:41.740935 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.740903    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"]
Sep 08 15:48:41.743652 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.743633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:41.745955 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.745919    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:48:41.746112 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.745996    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:48:41.746112 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.746025    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-twlpl\""
Sep 08 15:48:41.753712 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.753682    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"]
Sep 08 15:48:41.798089 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.797999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:41.815851 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.815810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:41.815958 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.815857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:41.816000 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.815947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn27f\" (UniqueName: \"kubernetes.io/projected/e15ddc82-58ea-4cbe-a643-b731f002fd84-kube-api-access-wn27f\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:41.856761 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.856726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"]
Sep 08 15:48:41.860527 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:48:41.860496    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb46ad6_dc65_47cc_a6e6_495613684200.slice/crio-e00e0a8a25bce839c7d8dd703b0f598d0461b8929b40b371a171a86052da617d WatchSource:0}: Error finding container e00e0a8a25bce839c7d8dd703b0f598d0461b8929b40b371a171a86052da617d: Status 404 returned error can't find the container with id e00e0a8a25bce839c7d8dd703b0f598d0461b8929b40b371a171a86052da617d
Sep 08 15:48:41.864019 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.863986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:41.916590 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.916551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:41.916590 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.916588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:41.916841 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.916641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn27f\" (UniqueName: \"kubernetes.io/projected/e15ddc82-58ea-4cbe-a643-b731f002fd84-kube-api-access-wn27f\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:41.917072 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.917049    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:41.917125 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.917055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:41.945492 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.945451    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn27f\" (UniqueName: \"kubernetes.io/projected/e15ddc82-58ea-4cbe-a643-b731f002fd84-kube-api-access-wn27f\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:41.987734 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:41.987701    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:42.054122 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:42.054031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:42.339506 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:42.339439    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"]
Sep 08 15:48:42.341799 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:48:42.341765    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15ddc82_58ea_4cbe_a643_b731f002fd84.slice/crio-081e221265503163b8fccf2897f46ed0ac86a512171cdbfdd7ba495a9013f56d WatchSource:0}: Error finding container 081e221265503163b8fccf2897f46ed0ac86a512171cdbfdd7ba495a9013f56d: Status 404 returned error can't find the container with id 081e221265503163b8fccf2897f46ed0ac86a512171cdbfdd7ba495a9013f56d
Sep 08 15:48:42.410713 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:42.410673    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk" event={"ID":"e15ddc82-58ea-4cbe-a643-b731f002fd84","Type":"ContainerStarted","Data":"ea26dd3485255b4dec1fa1a4ede1ada3923f58d9302e12b8b38caba32a7c1d86"}
Sep 08 15:48:42.410947 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:42.410742    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk" event={"ID":"e15ddc82-58ea-4cbe-a643-b731f002fd84","Type":"ContainerStarted","Data":"081e221265503163b8fccf2897f46ed0ac86a512171cdbfdd7ba495a9013f56d"}
Sep 08 15:48:42.412367 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:42.412338    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx" event={"ID":"eeb46ad6-dc65-47cc-a6e6-495613684200","Type":"ContainerStarted","Data":"e00e0a8a25bce839c7d8dd703b0f598d0461b8929b40b371a171a86052da617d"}
Sep 08 15:48:43.420323 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:43.420279    2581 generic.go:356] "Generic (PLEG): container finished" podID="e15ddc82-58ea-4cbe-a643-b731f002fd84" containerID="ea26dd3485255b4dec1fa1a4ede1ada3923f58d9302e12b8b38caba32a7c1d86" exitCode=0
Sep 08 15:48:43.420778 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:43.420339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk" event={"ID":"e15ddc82-58ea-4cbe-a643-b731f002fd84","Type":"ContainerDied","Data":"ea26dd3485255b4dec1fa1a4ede1ada3923f58d9302e12b8b38caba32a7c1d86"}
Sep 08 15:48:45.431481 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:45.431405    2581 generic.go:356] "Generic (PLEG): container finished" podID="e15ddc82-58ea-4cbe-a643-b731f002fd84" containerID="7aa4275aa267d8ad0c679272a998c5e81f97e0d617f2c2b0ca94a633ed539dbf" exitCode=0
Sep 08 15:48:45.431868 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:45.431483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk" event={"ID":"e15ddc82-58ea-4cbe-a643-b731f002fd84","Type":"ContainerDied","Data":"7aa4275aa267d8ad0c679272a998c5e81f97e0d617f2c2b0ca94a633ed539dbf"}
Sep 08 15:48:45.433374 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:45.433346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx" event={"ID":"eeb46ad6-dc65-47cc-a6e6-495613684200","Type":"ContainerStarted","Data":"79498ffdc1a905f9e6db9d68da083fa42798d70218f720bc27efc76420823cd5"}
Sep 08 15:48:46.439307 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:46.439269    2581 generic.go:356] "Generic (PLEG): container finished" podID="eeb46ad6-dc65-47cc-a6e6-495613684200" containerID="79498ffdc1a905f9e6db9d68da083fa42798d70218f720bc27efc76420823cd5" exitCode=0
Sep 08 15:48:46.439744 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:46.439317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx" event={"ID":"eeb46ad6-dc65-47cc-a6e6-495613684200","Type":"ContainerDied","Data":"79498ffdc1a905f9e6db9d68da083fa42798d70218f720bc27efc76420823cd5"}
Sep 08 15:48:46.442075 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:46.442002    2581 generic.go:356] "Generic (PLEG): container finished" podID="e15ddc82-58ea-4cbe-a643-b731f002fd84" containerID="d9ece2cff8d014e244076acc479784939ae1dfc54282829ac0c5826c7945f9e6" exitCode=0
Sep 08 15:48:46.442075 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:46.442039    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk" event={"ID":"e15ddc82-58ea-4cbe-a643-b731f002fd84","Type":"ContainerDied","Data":"d9ece2cff8d014e244076acc479784939ae1dfc54282829ac0c5826c7945f9e6"}
Sep 08 15:48:47.449012 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.448978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx" event={"ID":"eeb46ad6-dc65-47cc-a6e6-495613684200","Type":"ContainerStarted","Data":"4a83dc7fc4f9506a266d5ba2d89cbffa66e5cd8a6d7131a97a2cc0b97b356fcb"}
Sep 08 15:48:47.514591 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.514500    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx" podStartSLOduration=1.957274619 podStartE2EDuration="6.514481586s" totalImagesPullingTime="3.394840167s" totalInitContainerRuntime="1.1623668s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:48:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:48:47.51279199 +0000 UTC m=+255.634947631" watchObservedRunningTime="2026-09-08 15:48:47.514481586 +0000 UTC m=+255.636637202"
Sep 08 15:48:47.575206 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.575177    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:47.670765 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.670729    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-bundle\") pod \"e15ddc82-58ea-4cbe-a643-b731f002fd84\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") "
Sep 08 15:48:47.671002 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.670809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-util\") pod \"e15ddc82-58ea-4cbe-a643-b731f002fd84\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") "
Sep 08 15:48:47.671002 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.670888    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn27f\" (UniqueName: \"kubernetes.io/projected/e15ddc82-58ea-4cbe-a643-b731f002fd84-kube-api-access-wn27f\") pod \"e15ddc82-58ea-4cbe-a643-b731f002fd84\" (UID: \"e15ddc82-58ea-4cbe-a643-b731f002fd84\") "
Sep 08 15:48:47.671532 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.671507    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-bundle" (OuterVolumeSpecName: "bundle") pod "e15ddc82-58ea-4cbe-a643-b731f002fd84" (UID: "e15ddc82-58ea-4cbe-a643-b731f002fd84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:47.672909 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.672886    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15ddc82-58ea-4cbe-a643-b731f002fd84-kube-api-access-wn27f" (OuterVolumeSpecName: "kube-api-access-wn27f") pod "e15ddc82-58ea-4cbe-a643-b731f002fd84" (UID: "e15ddc82-58ea-4cbe-a643-b731f002fd84"). InnerVolumeSpecName "kube-api-access-wn27f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:48:47.678017 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.677989    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-util" (OuterVolumeSpecName: "util") pod "e15ddc82-58ea-4cbe-a643-b731f002fd84" (UID: "e15ddc82-58ea-4cbe-a643-b731f002fd84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:47.771672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.771587    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:48:47.771672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.771617    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn27f\" (UniqueName: \"kubernetes.io/projected/e15ddc82-58ea-4cbe-a643-b731f002fd84-kube-api-access-wn27f\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:48:47.771672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:47.771628    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e15ddc82-58ea-4cbe-a643-b731f002fd84-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:48:48.455603 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:48.455570    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk"
Sep 08 15:48:48.455603 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:48.455581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0gfpsk" event={"ID":"e15ddc82-58ea-4cbe-a643-b731f002fd84","Type":"ContainerDied","Data":"081e221265503163b8fccf2897f46ed0ac86a512171cdbfdd7ba495a9013f56d"}
Sep 08 15:48:48.456203 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:48.455633    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="081e221265503163b8fccf2897f46ed0ac86a512171cdbfdd7ba495a9013f56d"
Sep 08 15:48:48.456203 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:48.456012    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:48:48.835222 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:48.835184    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:48.938885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:48.938844    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:59.462864 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:48:59.462763    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d4b5866d6-s57fx"
Sep 08 15:49:00.962549 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:00.962516    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:01.102097 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:01.102064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:06.560856 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.560795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:06.569853 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.569805    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"]
Sep 08 15:49:06.570121 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.570107    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15ddc82-58ea-4cbe-a643-b731f002fd84" containerName="extract"
Sep 08 15:49:06.570167 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.570122    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15ddc82-58ea-4cbe-a643-b731f002fd84" containerName="extract"
Sep 08 15:49:06.570167 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.570133    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15ddc82-58ea-4cbe-a643-b731f002fd84" containerName="pull"
Sep 08 15:49:06.570167 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.570140    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15ddc82-58ea-4cbe-a643-b731f002fd84" containerName="pull"
Sep 08 15:49:06.570167 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.570150    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15ddc82-58ea-4cbe-a643-b731f002fd84" containerName="util"
Sep 08 15:49:06.570167 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.570155    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15ddc82-58ea-4cbe-a643-b731f002fd84" containerName="util"
Sep 08 15:49:06.570312 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.570201    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e15ddc82-58ea-4cbe-a643-b731f002fd84" containerName="extract"
Sep 08 15:49:06.573346 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.573328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:06.576467 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.576447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 15:49:06.577282 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.577264    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 15:49:06.577368 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.577349    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 15:49:06.579582 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.579558    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 15:49:06.586537 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.586510    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"]
Sep 08 15:49:06.731905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.731866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3509c93b-346f-4e53-a0b4-b36b93627589-tls-certs\") pod \"kube-auth-proxy-74bfc7b5fc-dtvk5\" (UID: \"3509c93b-346f-4e53-a0b4-b36b93627589\") " pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:06.732112 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.731945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d88k\" (UniqueName: \"kubernetes.io/projected/3509c93b-346f-4e53-a0b4-b36b93627589-kube-api-access-5d88k\") pod \"kube-auth-proxy-74bfc7b5fc-dtvk5\" (UID: \"3509c93b-346f-4e53-a0b4-b36b93627589\") " pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:06.732112 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.731984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3509c93b-346f-4e53-a0b4-b36b93627589-tmp\") pod \"kube-auth-proxy-74bfc7b5fc-dtvk5\" (UID: \"3509c93b-346f-4e53-a0b4-b36b93627589\") " pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:06.832606 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.832506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3509c93b-346f-4e53-a0b4-b36b93627589-tls-certs\") pod \"kube-auth-proxy-74bfc7b5fc-dtvk5\" (UID: \"3509c93b-346f-4e53-a0b4-b36b93627589\") " pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:06.832769 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:49:06.832669    2581 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 08 15:49:06.832769 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.832677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d88k\" (UniqueName: \"kubernetes.io/projected/3509c93b-346f-4e53-a0b4-b36b93627589-kube-api-access-5d88k\") pod \"kube-auth-proxy-74bfc7b5fc-dtvk5\" (UID: \"3509c93b-346f-4e53-a0b4-b36b93627589\") " pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:06.832769 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:49:06.832729    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3509c93b-346f-4e53-a0b4-b36b93627589-tls-certs podName:3509c93b-346f-4e53-a0b4-b36b93627589 nodeName:}" failed. No retries permitted until 2026-09-08 15:49:07.332713123 +0000 UTC m=+275.454868716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3509c93b-346f-4e53-a0b4-b36b93627589-tls-certs") pod "kube-auth-proxy-74bfc7b5fc-dtvk5" (UID: "3509c93b-346f-4e53-a0b4-b36b93627589") : secret "kube-auth-proxy-tls" not found
Sep 08 15:49:06.832769 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.832757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3509c93b-346f-4e53-a0b4-b36b93627589-tmp\") pod \"kube-auth-proxy-74bfc7b5fc-dtvk5\" (UID: \"3509c93b-346f-4e53-a0b4-b36b93627589\") " pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:06.834960 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.834942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3509c93b-346f-4e53-a0b4-b36b93627589-tmp\") pod \"kube-auth-proxy-74bfc7b5fc-dtvk5\" (UID: \"3509c93b-346f-4e53-a0b4-b36b93627589\") " pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:06.843161 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.843135    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d88k\" (UniqueName: \"kubernetes.io/projected/3509c93b-346f-4e53-a0b4-b36b93627589-kube-api-access-5d88k\") pod \"kube-auth-proxy-74bfc7b5fc-dtvk5\" (UID: \"3509c93b-346f-4e53-a0b4-b36b93627589\") " pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:06.911259 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:06.911220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:07.337783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.337726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3509c93b-346f-4e53-a0b4-b36b93627589-tls-certs\") pod \"kube-auth-proxy-74bfc7b5fc-dtvk5\" (UID: \"3509c93b-346f-4e53-a0b4-b36b93627589\") " pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:07.340293 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.340263    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3509c93b-346f-4e53-a0b4-b36b93627589-tls-certs\") pod \"kube-auth-proxy-74bfc7b5fc-dtvk5\" (UID: \"3509c93b-346f-4e53-a0b4-b36b93627589\") " pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:07.483085 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.483039    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"
Sep 08 15:49:07.739246 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.739197    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:07.742691 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.742663    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"]
Sep 08 15:49:07.746086 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.746067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.748065 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.748041    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 15:49:07.748203 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.748087    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:49:07.748203 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.748094    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 15:49:07.748203 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.748153    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 15:49:07.748203 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.748188    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gz7cn\""
Sep 08 15:49:07.759515 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.759484    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"]
Sep 08 15:49:07.761355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.761320    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5"]
Sep 08 15:49:07.764204 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:49:07.764178    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3509c93b_346f_4e53_a0b4_b36b93627589.slice/crio-3875f13b8b977791fa686564497764cb02374fbc18d0dec20b51b66e69687c9e WatchSource:0}: Error finding container 3875f13b8b977791fa686564497764cb02374fbc18d0dec20b51b66e69687c9e: Status 404 returned error can't find the container with id 3875f13b8b977791fa686564497764cb02374fbc18d0dec20b51b66e69687c9e
Sep 08 15:49:07.836874 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.836814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:07.842893 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.842860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.843066 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.842924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/24500233-69b4-4ce3-b4fd-59ef8aee095b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.843066 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.842976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.843159 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.843070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llzkk\" (UniqueName: \"kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-kube-api-access-llzkk\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.843159 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.843130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.843159 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.843156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.843267 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.843196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.943663 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.943624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.943663 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.943667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.943944 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.943692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.943944 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.943727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/24500233-69b4-4ce3-b4fd-59ef8aee095b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.943944 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.943753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.943944 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.943780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llzkk\" (UniqueName: \"kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-kube-api-access-llzkk\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.943944 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.943859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.944437 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.944414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.946126 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.946104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/24500233-69b4-4ce3-b4fd-59ef8aee095b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.946217 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.946143    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.946469 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.946449    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.946562 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.946541    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.951356 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.951326    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llzkk\" (UniqueName: \"kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-kube-api-access-llzkk\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:07.951501 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:07.951486    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-snj4s\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:08.056104 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:08.056009    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:08.330628 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:08.330548    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"]
Sep 08 15:49:08.333721 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:49:08.333697    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24500233_69b4_4ce3_b4fd_59ef8aee095b.slice/crio-9fd01e27e6e99367abcdcc4fcf99dcd4c3a3004714dab97f4471f6b258587287 WatchSource:0}: Error finding container 9fd01e27e6e99367abcdcc4fcf99dcd4c3a3004714dab97f4471f6b258587287: Status 404 returned error can't find the container with id 9fd01e27e6e99367abcdcc4fcf99dcd4c3a3004714dab97f4471f6b258587287
Sep 08 15:49:08.547221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:08.547174    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5" event={"ID":"3509c93b-346f-4e53-a0b4-b36b93627589","Type":"ContainerStarted","Data":"3875f13b8b977791fa686564497764cb02374fbc18d0dec20b51b66e69687c9e"}
Sep 08 15:49:08.549076 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:08.549036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s" event={"ID":"24500233-69b4-4ce3-b4fd-59ef8aee095b","Type":"ContainerStarted","Data":"9fd01e27e6e99367abcdcc4fcf99dcd4c3a3004714dab97f4471f6b258587287"}
Sep 08 15:49:08.696102 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:08.696051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:11.566063 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:11.566016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5" event={"ID":"3509c93b-346f-4e53-a0b4-b36b93627589","Type":"ContainerStarted","Data":"877e890e41bda85fd3dce689b95589320d27e07ae089fcc313d76739e0db34a9"}
Sep 08 15:49:11.583343 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:11.583285    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74bfc7b5fc-dtvk5" podStartSLOduration=2.765916593 podStartE2EDuration="5.583267404s" totalImagesPullingTime="2.817350811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:49:11.580745128 +0000 UTC m=+279.702900743" watchObservedRunningTime="2026-09-08 15:49:11.583267404 +0000 UTC m=+279.705423019"
Sep 08 15:49:11.802474 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:11.802394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:11.863284 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:11.863249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:12.038472 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:12.038427    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:12.135496 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:12.135413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:12.245276 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:12.245229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:12.359441 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:12.359395    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:49:12.359535 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:12.359482    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:49:12.410160 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:12.410130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:12.572648 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:12.572603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s" event={"ID":"24500233-69b4-4ce3-b4fd-59ef8aee095b","Type":"ContainerStarted","Data":"cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10"}
Sep 08 15:49:12.573158 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:12.572691    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:12.598166 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:12.598112    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s" podStartSLOduration=1.574689384 podStartE2EDuration="5.598094442s" totalImagesPullingTime="4.023405058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:49:12.596764332 +0000 UTC m=+280.718919946" watchObservedRunningTime="2026-09-08 15:49:12.598094442 +0000 UTC m=+280.720250057"
Sep 08 15:49:13.015258 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:13.015179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:13.079316 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:13.079266    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:13.579519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:13.579482    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-snj4s container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:49:13.579901 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:13.579542    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s" podUID="24500233-69b4-4ce3-b4fd-59ef8aee095b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:49:13.698750 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:13.698720    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:14.037270 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:14.037237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:14.369701 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:14.369596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:16.578875 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:16.578814    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:20.695970 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.695936    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"]
Sep 08 15:49:20.703211 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.703180    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.712719 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.712686    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"]
Sep 08 15:49:20.761327 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.761289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp6rl\" (UniqueName: \"kubernetes.io/projected/381ee37a-a63e-4e9a-854e-a32361d39d1f-kube-api-access-zp6rl\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.761327 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.761330    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.761541 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.761398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.761541 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.761454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/381ee37a-a63e-4e9a-854e-a32361d39d1f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.761541 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.761473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/381ee37a-a63e-4e9a-854e-a32361d39d1f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.761541 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.761502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.761541 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.761531    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.862560 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.862518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp6rl\" (UniqueName: \"kubernetes.io/projected/381ee37a-a63e-4e9a-854e-a32361d39d1f-kube-api-access-zp6rl\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.862560 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.862563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.862782 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.862602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.862782 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.862628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/381ee37a-a63e-4e9a-854e-a32361d39d1f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.862782 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.862645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/381ee37a-a63e-4e9a-854e-a32361d39d1f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.862782 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.862668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.863018 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.862792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.863744 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.863713    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.865244 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.865216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/381ee37a-a63e-4e9a-854e-a32361d39d1f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.865362 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.865217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.865362 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.865226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/381ee37a-a63e-4e9a-854e-a32361d39d1f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.865362 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.865288    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.870692 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.870668    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp6rl\" (UniqueName: \"kubernetes.io/projected/381ee37a-a63e-4e9a-854e-a32361d39d1f-kube-api-access-zp6rl\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:20.870809 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:20.870702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381ee37a-a63e-4e9a-854e-a32361d39d1f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fd2nk\" (UID: \"381ee37a-a63e-4e9a-854e-a32361d39d1f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:21.013299 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:21.013204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:21.291447 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:21.291421    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"]
Sep 08 15:49:21.293781 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:49:21.293748    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381ee37a_a63e_4e9a_854e_a32361d39d1f.slice/crio-6e0b1ce14c38e475756f622018cf77dda864aaba45f614789f7e02399d139be3 WatchSource:0}: Error finding container 6e0b1ce14c38e475756f622018cf77dda864aaba45f614789f7e02399d139be3: Status 404 returned error can't find the container with id 6e0b1ce14c38e475756f622018cf77dda864aaba45f614789f7e02399d139be3
Sep 08 15:49:21.296867 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:21.296808    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:49:21.296953 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:21.296898    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:49:21.618531 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:21.618449    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk" event={"ID":"381ee37a-a63e-4e9a-854e-a32361d39d1f","Type":"ContainerStarted","Data":"ab6ca7e53871aad5148e2ed71030d6a5f915f2e1127f6e60e961ddf920dec39a"}
Sep 08 15:49:21.618531 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:21.618494    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk" event={"ID":"381ee37a-a63e-4e9a-854e-a32361d39d1f","Type":"ContainerStarted","Data":"6e0b1ce14c38e475756f622018cf77dda864aaba45f614789f7e02399d139be3"}
Sep 08 15:49:21.618756 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:21.618575    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:21.655567 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:21.655510    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk" podStartSLOduration=1.65549085 podStartE2EDuration="1.65549085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:49:21.653213638 +0000 UTC m=+289.775369246" watchObservedRunningTime="2026-09-08 15:49:21.65549085 +0000 UTC m=+289.777646464"
Sep 08 15:49:22.624545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.624513    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fd2nk"
Sep 08 15:49:22.689124 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.689091    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"]
Sep 08 15:49:22.689291 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.689272    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s" podUID="24500233-69b4-4ce3-b4fd-59ef8aee095b" containerName="discovery" containerID="cri-o://cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10" gracePeriod=30
Sep 08 15:49:22.932349 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.932324    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:22.989195 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.989159    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-ca-configmap\") pod \"24500233-69b4-4ce3-b4fd-59ef8aee095b\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") "
Sep 08 15:49:22.989377 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.989270    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-cacerts\") pod \"24500233-69b4-4ce3-b4fd-59ef8aee095b\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") "
Sep 08 15:49:22.989377 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.989323    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-dns-cert\") pod \"24500233-69b4-4ce3-b4fd-59ef8aee095b\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") "
Sep 08 15:49:22.989377 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.989347    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-token\") pod \"24500233-69b4-4ce3-b4fd-59ef8aee095b\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") "
Sep 08 15:49:22.989538 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.989404    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llzkk\" (UniqueName: \"kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-kube-api-access-llzkk\") pod \"24500233-69b4-4ce3-b4fd-59ef8aee095b\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") "
Sep 08 15:49:22.989538 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.989442    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-kubeconfig\") pod \"24500233-69b4-4ce3-b4fd-59ef8aee095b\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") "
Sep 08 15:49:22.989538 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.989494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/24500233-69b4-4ce3-b4fd-59ef8aee095b-local-certs\") pod \"24500233-69b4-4ce3-b4fd-59ef8aee095b\" (UID: \"24500233-69b4-4ce3-b4fd-59ef8aee095b\") "
Sep 08 15:49:22.989678 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.989581    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "24500233-69b4-4ce3-b4fd-59ef8aee095b" (UID: "24500233-69b4-4ce3-b4fd-59ef8aee095b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:49:22.989794 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.989775    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-ca-configmap\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:49:22.992264 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.992226    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "24500233-69b4-4ce3-b4fd-59ef8aee095b" (UID: "24500233-69b4-4ce3-b4fd-59ef8aee095b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:49:22.992394 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.992353    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-token" (OuterVolumeSpecName: "istio-token") pod "24500233-69b4-4ce3-b4fd-59ef8aee095b" (UID: "24500233-69b4-4ce3-b4fd-59ef8aee095b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:49:22.992462 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.992425    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24500233-69b4-4ce3-b4fd-59ef8aee095b-local-certs" (OuterVolumeSpecName: "local-certs") pod "24500233-69b4-4ce3-b4fd-59ef8aee095b" (UID: "24500233-69b4-4ce3-b4fd-59ef8aee095b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:49:22.992750 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.992728    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-cacerts" (OuterVolumeSpecName: "cacerts") pod "24500233-69b4-4ce3-b4fd-59ef8aee095b" (UID: "24500233-69b4-4ce3-b4fd-59ef8aee095b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:49:22.992936 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.992919    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-kube-api-access-llzkk" (OuterVolumeSpecName: "kube-api-access-llzkk") pod "24500233-69b4-4ce3-b4fd-59ef8aee095b" (UID: "24500233-69b4-4ce3-b4fd-59ef8aee095b"). InnerVolumeSpecName "kube-api-access-llzkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:49:22.993197 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:22.993175    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "24500233-69b4-4ce3-b4fd-59ef8aee095b" (UID: "24500233-69b4-4ce3-b4fd-59ef8aee095b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:49:23.090565 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.090521    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-cacerts\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:49:23.090565 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.090557    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-csr-dns-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:49:23.090565 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.090571    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-token\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:49:23.090815 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.090584    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llzkk\" (UniqueName: \"kubernetes.io/projected/24500233-69b4-4ce3-b4fd-59ef8aee095b-kube-api-access-llzkk\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:49:23.090815 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.090596    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24500233-69b4-4ce3-b4fd-59ef8aee095b-istio-kubeconfig\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:49:23.090815 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.090609    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/24500233-69b4-4ce3-b4fd-59ef8aee095b-local-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:49:23.154708 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.154645    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:23.209104 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.209015    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"]
Sep 08 15:49:23.209487 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.209471    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24500233-69b4-4ce3-b4fd-59ef8aee095b" containerName="discovery"
Sep 08 15:49:23.209533 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.209491    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="24500233-69b4-4ce3-b4fd-59ef8aee095b" containerName="discovery"
Sep 08 15:49:23.209584 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.209573    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="24500233-69b4-4ce3-b4fd-59ef8aee095b" containerName="discovery"
Sep 08 15:49:23.211986 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.211964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"
Sep 08 15:49:23.214046 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.214019    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-h4st9\""
Sep 08 15:49:23.214175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.214134    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 08 15:49:23.218252 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.218224    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"]
Sep 08 15:49:23.220968 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.220946    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:49:23.222031 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.222006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"]
Sep 08 15:49:23.223234 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.223211    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 15:49:23.223342 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.223319    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wqz42\""
Sep 08 15:49:23.239251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.239215    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"]
Sep 08 15:49:23.292812 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.292772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qnqk\" (UniqueName: \"kubernetes.io/projected/f5023456-979a-4b89-8e1e-f61c5c638c51-kube-api-access-2qnqk\") pod \"llmisvc-controller-manager-777c6bd7d5-ph22l\" (UID: \"f5023456-979a-4b89-8e1e-f61c5c638c51\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:49:23.292812 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.292813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0361c5f8-c510-4f69-a963-248bde9b863b-cert\") pod \"kserve-controller-manager-d6f4b65b8-g42hv\" (UID: \"0361c5f8-c510-4f69-a963-248bde9b863b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"
Sep 08 15:49:23.293048 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.292893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9nn5\" (UniqueName: \"kubernetes.io/projected/0361c5f8-c510-4f69-a963-248bde9b863b-kube-api-access-g9nn5\") pod \"kserve-controller-manager-d6f4b65b8-g42hv\" (UID: \"0361c5f8-c510-4f69-a963-248bde9b863b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"
Sep 08 15:49:23.293048 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.292911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5023456-979a-4b89-8e1e-f61c5c638c51-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ph22l\" (UID: \"f5023456-979a-4b89-8e1e-f61c5c638c51\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:49:23.393612 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.393578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qnqk\" (UniqueName: \"kubernetes.io/projected/f5023456-979a-4b89-8e1e-f61c5c638c51-kube-api-access-2qnqk\") pod \"llmisvc-controller-manager-777c6bd7d5-ph22l\" (UID: \"f5023456-979a-4b89-8e1e-f61c5c638c51\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:49:23.393612 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.393616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0361c5f8-c510-4f69-a963-248bde9b863b-cert\") pod \"kserve-controller-manager-d6f4b65b8-g42hv\" (UID: \"0361c5f8-c510-4f69-a963-248bde9b863b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"
Sep 08 15:49:23.393858 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.393655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9nn5\" (UniqueName: \"kubernetes.io/projected/0361c5f8-c510-4f69-a963-248bde9b863b-kube-api-access-g9nn5\") pod \"kserve-controller-manager-d6f4b65b8-g42hv\" (UID: \"0361c5f8-c510-4f69-a963-248bde9b863b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"
Sep 08 15:49:23.393858 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.393680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5023456-979a-4b89-8e1e-f61c5c638c51-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ph22l\" (UID: \"f5023456-979a-4b89-8e1e-f61c5c638c51\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:49:23.393858 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:49:23.393789    2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 08 15:49:23.393965 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:49:23.393888    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5023456-979a-4b89-8e1e-f61c5c638c51-cert podName:f5023456-979a-4b89-8e1e-f61c5c638c51 nodeName:}" failed. No retries permitted until 2026-09-08 15:49:23.893867652 +0000 UTC m=+292.016023248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5023456-979a-4b89-8e1e-f61c5c638c51-cert") pod "llmisvc-controller-manager-777c6bd7d5-ph22l" (UID: "f5023456-979a-4b89-8e1e-f61c5c638c51") : secret "llmisvc-webhook-server-cert" not found
Sep 08 15:49:23.396359 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.396322    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0361c5f8-c510-4f69-a963-248bde9b863b-cert\") pod \"kserve-controller-manager-d6f4b65b8-g42hv\" (UID: \"0361c5f8-c510-4f69-a963-248bde9b863b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"
Sep 08 15:49:23.415448 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.415419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9nn5\" (UniqueName: \"kubernetes.io/projected/0361c5f8-c510-4f69-a963-248bde9b863b-kube-api-access-g9nn5\") pod \"kserve-controller-manager-d6f4b65b8-g42hv\" (UID: \"0361c5f8-c510-4f69-a963-248bde9b863b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"
Sep 08 15:49:23.416331 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.416307    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qnqk\" (UniqueName: \"kubernetes.io/projected/f5023456-979a-4b89-8e1e-f61c5c638c51-kube-api-access-2qnqk\") pod \"llmisvc-controller-manager-777c6bd7d5-ph22l\" (UID: \"f5023456-979a-4b89-8e1e-f61c5c638c51\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:49:23.525030 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.524939    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"
Sep 08 15:49:23.629253 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.629216    2581 generic.go:356] "Generic (PLEG): container finished" podID="24500233-69b4-4ce3-b4fd-59ef8aee095b" containerID="cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10" exitCode=0
Sep 08 15:49:23.629635 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.629267    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"
Sep 08 15:49:23.629635 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.629309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s" event={"ID":"24500233-69b4-4ce3-b4fd-59ef8aee095b","Type":"ContainerDied","Data":"cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10"}
Sep 08 15:49:23.629635 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.629378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s" event={"ID":"24500233-69b4-4ce3-b4fd-59ef8aee095b","Type":"ContainerDied","Data":"9fd01e27e6e99367abcdcc4fcf99dcd4c3a3004714dab97f4471f6b258587287"}
Sep 08 15:49:23.629635 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.629411    2581 scope.go:117] "RemoveContainer" containerID="cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10"
Sep 08 15:49:23.638918 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.638892    2581 scope.go:117] "RemoveContainer" containerID="cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10"
Sep 08 15:49:23.639274 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:49:23.639248    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10\": container with ID starting with cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10 not found: ID does not exist" containerID="cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10"
Sep 08 15:49:23.639365 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.639282    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10"} err="failed to get container status \"cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10\": rpc error: code = NotFound desc = could not find container \"cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10\": container with ID starting with cb282cc2337b4aa688a3df324fd2ddf186093a38b17ea43383208d5b248c4a10 not found: ID does not exist"
Sep 08 15:49:23.656416 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.656381    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"]
Sep 08 15:49:23.662966 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.662934    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-snj4s"]
Sep 08 15:49:23.796621 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.796593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"]
Sep 08 15:49:23.798610 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:49:23.798575    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0361c5f8_c510_4f69_a963_248bde9b863b.slice/crio-859178fce6dbd66076017ce4098642ff4e1fd7d896ac956cad9bb3d3133ac601 WatchSource:0}: Error finding container 859178fce6dbd66076017ce4098642ff4e1fd7d896ac956cad9bb3d3133ac601: Status 404 returned error can't find the container with id 859178fce6dbd66076017ce4098642ff4e1fd7d896ac956cad9bb3d3133ac601
Sep 08 15:49:23.899544 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.899504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5023456-979a-4b89-8e1e-f61c5c638c51-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ph22l\" (UID: \"f5023456-979a-4b89-8e1e-f61c5c638c51\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:49:23.901946 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:23.901910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5023456-979a-4b89-8e1e-f61c5c638c51-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ph22l\" (UID: \"f5023456-979a-4b89-8e1e-f61c5c638c51\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:49:24.133696 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:24.133596    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:49:24.366061 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:24.366023    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24500233-69b4-4ce3-b4fd-59ef8aee095b" path="/var/lib/kubelet/pods/24500233-69b4-4ce3-b4fd-59ef8aee095b/volumes"
Sep 08 15:49:24.413535 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:24.413456    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"]
Sep 08 15:49:24.415807 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:49:24.415775    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf5023456_979a_4b89_8e1e_f61c5c638c51.slice/crio-d9165e8386c6eb3d231e310eb06d75700378e2ac2f549ed70c4a943ec74e9115 WatchSource:0}: Error finding container d9165e8386c6eb3d231e310eb06d75700378e2ac2f549ed70c4a943ec74e9115: Status 404 returned error can't find the container with id d9165e8386c6eb3d231e310eb06d75700378e2ac2f549ed70c4a943ec74e9115
Sep 08 15:49:24.567739 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:24.567665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:24.635754 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:24.635716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv" event={"ID":"0361c5f8-c510-4f69-a963-248bde9b863b","Type":"ContainerStarted","Data":"859178fce6dbd66076017ce4098642ff4e1fd7d896ac956cad9bb3d3133ac601"}
Sep 08 15:49:24.636920 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:24.636893    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l" event={"ID":"f5023456-979a-4b89-8e1e-f61c5c638c51","Type":"ContainerStarted","Data":"d9165e8386c6eb3d231e310eb06d75700378e2ac2f549ed70c4a943ec74e9115"}
Sep 08 15:49:26.653153 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:26.653105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv" event={"ID":"0361c5f8-c510-4f69-a963-248bde9b863b","Type":"ContainerStarted","Data":"4ba5949302b9fd503470cee93a93ea2e9132c74dfcce52a5fe63a55bb966b2af"}
Sep 08 15:49:26.653623 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:26.653327    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"
Sep 08 15:49:26.683677 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:26.683619    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv" podStartSLOduration=1.206735727 podStartE2EDuration="3.683598714s" totalImagesPullingTime="2.476862987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:49:26.681541999 +0000 UTC m=+294.803697616" watchObservedRunningTime="2026-09-08 15:49:26.683598714 +0000 UTC m=+294.805754385"
Sep 08 15:49:27.660159 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:27.660104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l" event={"ID":"f5023456-979a-4b89-8e1e-f61c5c638c51","Type":"ContainerStarted","Data":"7c9b8f849549c359e69631c80fb99aa493f16c234524ee498da55d09e66c2ee0"}
Sep 08 15:49:27.680083 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:27.680025    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l" podStartSLOduration=1.664117901 podStartE2EDuration="4.680006026s" totalImagesPullingTime="3.015888125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:49:27.6787621 +0000 UTC m=+295.800917717" watchObservedRunningTime="2026-09-08 15:49:27.680006026 +0000 UTC m=+295.802161642"
Sep 08 15:49:28.664832 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:28.664799    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:49:32.254459 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:32.254435    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 15:49:47.749347 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:47.749309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:47.819361 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:47.819328    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:57.666077 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:57.666042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g42hv"
Sep 08 15:49:59.672772 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:49:59.672741    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ph22l"
Sep 08 15:50:13.103565 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:13.103528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:13.232255 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:13.232216    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:16.328646 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.328610    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"]
Sep 08 15:50:16.339319 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.339287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.340665 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.340635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"]
Sep 08 15:50:16.341444 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.341417    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:50:16.341570 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.341482    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:50:16.342249 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.342233    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-twlpl\""
Sep 08 15:50:16.428609 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.428570    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"]
Sep 08 15:50:16.431123 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.431104    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.439641 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.439611    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"]
Sep 08 15:50:16.478389 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.478344    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.478564 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.478441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.478564 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.478463    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkzv2\" (UniqueName: \"kubernetes.io/projected/2c954035-6107-415f-b571-dc383bb19b82-kube-api-access-mkzv2\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.527687 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.527649    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"]
Sep 08 15:50:16.530123 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.530105    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.539973 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.539946    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"]
Sep 08 15:50:16.579404 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.579304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.579404 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.579350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsbqd\" (UniqueName: \"kubernetes.io/projected/60cd2d00-c86c-4856-86aa-d975464aedbf-kube-api-access-fsbqd\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.579404 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.579395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.579638 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.579418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.579638 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.579476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.579638 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.579492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkzv2\" (UniqueName: \"kubernetes.io/projected/2c954035-6107-415f-b571-dc383bb19b82-kube-api-access-mkzv2\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.579750 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.579694    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.579796 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.579749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.590956 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.590930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkzv2\" (UniqueName: \"kubernetes.io/projected/2c954035-6107-415f-b571-dc383bb19b82-kube-api-access-mkzv2\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.629660 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.629620    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"]
Sep 08 15:50:16.632320 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.632301    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:16.641262 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.641232    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"]
Sep 08 15:50:16.651275 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.651240    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:16.680873 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.680808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68c6\" (UniqueName: \"kubernetes.io/projected/541719ed-e276-466c-9b19-bcf112e7e834-kube-api-access-x68c6\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.680873 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.680877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.681136 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.680924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.681136 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.680950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.681136 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.681004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.681136 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.681039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsbqd\" (UniqueName: \"kubernetes.io/projected/60cd2d00-c86c-4856-86aa-d975464aedbf-kube-api-access-fsbqd\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.681366 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.681265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.681366 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.681300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.688896 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.688854    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsbqd\" (UniqueName: \"kubernetes.io/projected/60cd2d00-c86c-4856-86aa-d975464aedbf-kube-api-access-fsbqd\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.741065 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.741026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:16.782317 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.782271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68c6\" (UniqueName: \"kubernetes.io/projected/541719ed-e276-466c-9b19-bcf112e7e834-kube-api-access-x68c6\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.782464 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.782329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.782464 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.782381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sknxp\" (UniqueName: \"kubernetes.io/projected/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-kube-api-access-sknxp\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:16.782464 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.782409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:16.782464 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.782455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:16.782625 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.782508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.782991 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.782968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.783046 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.782987    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.793110 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.792960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68c6\" (UniqueName: \"kubernetes.io/projected/541719ed-e276-466c-9b19-bcf112e7e834-kube-api-access-x68c6\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.840774 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.840680    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:16.883153 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.883121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sknxp\" (UniqueName: \"kubernetes.io/projected/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-kube-api-access-sknxp\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:16.883153 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.883160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:16.883398 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.883205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:16.883682 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.883657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:16.883718 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.883693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:16.892935 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.892804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sknxp\" (UniqueName: \"kubernetes.io/projected/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-kube-api-access-sknxp\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:16.929344 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.929317    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"]
Sep 08 15:50:16.931549 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:50:16.931520    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c954035_6107_415f_b571_dc383bb19b82.slice/crio-21cc040ef78aceaa6739b1fe8e078e6636bf2d96e3033d88e788656161d572d5 WatchSource:0}: Error finding container 21cc040ef78aceaa6739b1fe8e078e6636bf2d96e3033d88e788656161d572d5: Status 404 returned error can't find the container with id 21cc040ef78aceaa6739b1fe8e078e6636bf2d96e3033d88e788656161d572d5
Sep 08 15:50:16.943342 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:16.943312    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:17.026558 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.026508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"]
Sep 08 15:50:17.027867 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:50:17.027835    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60cd2d00_c86c_4856_86aa_d975464aedbf.slice/crio-b2b281e694a801aa0731d3413d480a4f337b552932b1ebeed30c23c6d461b2df WatchSource:0}: Error finding container b2b281e694a801aa0731d3413d480a4f337b552932b1ebeed30c23c6d461b2df: Status 404 returned error can't find the container with id b2b281e694a801aa0731d3413d480a4f337b552932b1ebeed30c23c6d461b2df
Sep 08 15:50:17.118735 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.118658    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"]
Sep 08 15:50:17.129361 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:50:17.129329    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541719ed_e276_466c_9b19_bcf112e7e834.slice/crio-8a0ce66e177bcdbf3062765c0c85a2d12ff512ce54d26d97832b12a9da120712 WatchSource:0}: Error finding container 8a0ce66e177bcdbf3062765c0c85a2d12ff512ce54d26d97832b12a9da120712: Status 404 returned error can't find the container with id 8a0ce66e177bcdbf3062765c0c85a2d12ff512ce54d26d97832b12a9da120712
Sep 08 15:50:17.223781 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.223755    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"]
Sep 08 15:50:17.252869 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:50:17.252807    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1e9fb5_8a75_43c3_9ef8_afc95ab14d37.slice/crio-76a67f502fd3b4a9a93d8b971bfadf9c29ecb9994f20f5a317453a4bfa987140 WatchSource:0}: Error finding container 76a67f502fd3b4a9a93d8b971bfadf9c29ecb9994f20f5a317453a4bfa987140: Status 404 returned error can't find the container with id 76a67f502fd3b4a9a93d8b971bfadf9c29ecb9994f20f5a317453a4bfa987140
Sep 08 15:50:17.890913 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.890871    2581 generic.go:356] "Generic (PLEG): container finished" podID="541719ed-e276-466c-9b19-bcf112e7e834" containerID="5c77dd5c9da67047b1669806bc70d369df658d998087789e998df9d1324f29bb" exitCode=0
Sep 08 15:50:17.891416 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.890968    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4" event={"ID":"541719ed-e276-466c-9b19-bcf112e7e834","Type":"ContainerDied","Data":"5c77dd5c9da67047b1669806bc70d369df658d998087789e998df9d1324f29bb"}
Sep 08 15:50:17.891416 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.891031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4" event={"ID":"541719ed-e276-466c-9b19-bcf112e7e834","Type":"ContainerStarted","Data":"8a0ce66e177bcdbf3062765c0c85a2d12ff512ce54d26d97832b12a9da120712"}
Sep 08 15:50:17.892095 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.892075    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:50:17.892803 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.892783    2581 generic.go:356] "Generic (PLEG): container finished" podID="ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" containerID="d4c752f814abce115c32043412a9d3d394f1410cb3971e00bce2bb0bc50f04de" exitCode=0
Sep 08 15:50:17.892915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.892858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7" event={"ID":"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37","Type":"ContainerDied","Data":"d4c752f814abce115c32043412a9d3d394f1410cb3971e00bce2bb0bc50f04de"}
Sep 08 15:50:17.892983 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.892917    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7" event={"ID":"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37","Type":"ContainerStarted","Data":"76a67f502fd3b4a9a93d8b971bfadf9c29ecb9994f20f5a317453a4bfa987140"}
Sep 08 15:50:17.897889 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.897866    2581 generic.go:356] "Generic (PLEG): container finished" podID="60cd2d00-c86c-4856-86aa-d975464aedbf" containerID="edfa88f0d1a9f983c54850f14c3a6c6f699593d503b8ba6cfaa96d79761fc821" exitCode=0
Sep 08 15:50:17.897980 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.897949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc" event={"ID":"60cd2d00-c86c-4856-86aa-d975464aedbf","Type":"ContainerDied","Data":"edfa88f0d1a9f983c54850f14c3a6c6f699593d503b8ba6cfaa96d79761fc821"}
Sep 08 15:50:17.898055 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.898016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc" event={"ID":"60cd2d00-c86c-4856-86aa-d975464aedbf","Type":"ContainerStarted","Data":"b2b281e694a801aa0731d3413d480a4f337b552932b1ebeed30c23c6d461b2df"}
Sep 08 15:50:17.900060 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.900040    2581 generic.go:356] "Generic (PLEG): container finished" podID="2c954035-6107-415f-b571-dc383bb19b82" containerID="3c78e4dc4ac68ad284382b0fd8030141588a257ea5bc4906fa503799cb20ae7c" exitCode=0
Sep 08 15:50:17.900152 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.900070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv" event={"ID":"2c954035-6107-415f-b571-dc383bb19b82","Type":"ContainerDied","Data":"3c78e4dc4ac68ad284382b0fd8030141588a257ea5bc4906fa503799cb20ae7c"}
Sep 08 15:50:17.900152 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:17.900101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv" event={"ID":"2c954035-6107-415f-b571-dc383bb19b82","Type":"ContainerStarted","Data":"21cc040ef78aceaa6739b1fe8e078e6636bf2d96e3033d88e788656161d572d5"}
Sep 08 15:50:18.906924 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:18.906870    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7" event={"ID":"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37","Type":"ContainerStarted","Data":"2ef9e22929967f8585c09dd055fbf84cc4d60c1459fcdaf19bf090638db975fd"}
Sep 08 15:50:19.914377 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:19.914339    2581 generic.go:356] "Generic (PLEG): container finished" podID="ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" containerID="2ef9e22929967f8585c09dd055fbf84cc4d60c1459fcdaf19bf090638db975fd" exitCode=0
Sep 08 15:50:19.914834 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:19.914415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7" event={"ID":"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37","Type":"ContainerDied","Data":"2ef9e22929967f8585c09dd055fbf84cc4d60c1459fcdaf19bf090638db975fd"}
Sep 08 15:50:19.916438 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:19.916411    2581 generic.go:356] "Generic (PLEG): container finished" podID="60cd2d00-c86c-4856-86aa-d975464aedbf" containerID="67e2f48ee42859375cff7e3e8a47c251ea2dcc8d15212acc64176812c60433e4" exitCode=0
Sep 08 15:50:19.916540 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:19.916496    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc" event={"ID":"60cd2d00-c86c-4856-86aa-d975464aedbf","Type":"ContainerDied","Data":"67e2f48ee42859375cff7e3e8a47c251ea2dcc8d15212acc64176812c60433e4"}
Sep 08 15:50:20.922933 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:20.922891    2581 generic.go:356] "Generic (PLEG): container finished" podID="ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" containerID="0d551960ec2e14c9e022ef6c5f48d81358a937b166099c910bb492a8a7b13562" exitCode=0
Sep 08 15:50:20.923382 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:20.922992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7" event={"ID":"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37","Type":"ContainerDied","Data":"0d551960ec2e14c9e022ef6c5f48d81358a937b166099c910bb492a8a7b13562"}
Sep 08 15:50:20.924897 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:20.924874    2581 generic.go:356] "Generic (PLEG): container finished" podID="60cd2d00-c86c-4856-86aa-d975464aedbf" containerID="16f36ee886f0714c0226d452dbe085eb3a8d9cc343bfa3ac2535943b7f95e8b3" exitCode=0
Sep 08 15:50:20.925001 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:20.924946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc" event={"ID":"60cd2d00-c86c-4856-86aa-d975464aedbf","Type":"ContainerDied","Data":"16f36ee886f0714c0226d452dbe085eb3a8d9cc343bfa3ac2535943b7f95e8b3"}
Sep 08 15:50:21.931495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:21.931459    2581 generic.go:356] "Generic (PLEG): container finished" podID="541719ed-e276-466c-9b19-bcf112e7e834" containerID="dc599940a3bc1dabc1b3b9b3036acfbd0c6bcd3cc439aa4a65a827862d3b0054" exitCode=0
Sep 08 15:50:21.931969 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:21.931546    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4" event={"ID":"541719ed-e276-466c-9b19-bcf112e7e834","Type":"ContainerDied","Data":"dc599940a3bc1dabc1b3b9b3036acfbd0c6bcd3cc439aa4a65a827862d3b0054"}
Sep 08 15:50:22.078623 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.078601    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:22.138175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.138148    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:22.229381 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.229291    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-bundle\") pod \"60cd2d00-c86c-4856-86aa-d975464aedbf\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") "
Sep 08 15:50:22.229381 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.229335    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-bundle\") pod \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") "
Sep 08 15:50:22.229573 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.229416    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sknxp\" (UniqueName: \"kubernetes.io/projected/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-kube-api-access-sknxp\") pod \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") "
Sep 08 15:50:22.229573 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.229437    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsbqd\" (UniqueName: \"kubernetes.io/projected/60cd2d00-c86c-4856-86aa-d975464aedbf-kube-api-access-fsbqd\") pod \"60cd2d00-c86c-4856-86aa-d975464aedbf\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") "
Sep 08 15:50:22.229573 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.229471    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-util\") pod \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\" (UID: \"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37\") "
Sep 08 15:50:22.229573 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.229494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-util\") pod \"60cd2d00-c86c-4856-86aa-d975464aedbf\" (UID: \"60cd2d00-c86c-4856-86aa-d975464aedbf\") "
Sep 08 15:50:22.230059 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.230019    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-bundle" (OuterVolumeSpecName: "bundle") pod "60cd2d00-c86c-4856-86aa-d975464aedbf" (UID: "60cd2d00-c86c-4856-86aa-d975464aedbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:22.230257 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.230233    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-bundle" (OuterVolumeSpecName: "bundle") pod "ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" (UID: "ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:22.231656 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.231629    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60cd2d00-c86c-4856-86aa-d975464aedbf-kube-api-access-fsbqd" (OuterVolumeSpecName: "kube-api-access-fsbqd") pod "60cd2d00-c86c-4856-86aa-d975464aedbf" (UID: "60cd2d00-c86c-4856-86aa-d975464aedbf"). InnerVolumeSpecName "kube-api-access-fsbqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:50:22.231745 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.231673    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-kube-api-access-sknxp" (OuterVolumeSpecName: "kube-api-access-sknxp") pod "ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" (UID: "ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37"). InnerVolumeSpecName "kube-api-access-sknxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:50:22.235009 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.234976    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-util" (OuterVolumeSpecName: "util") pod "ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" (UID: "ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:22.330329 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.330292    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sknxp\" (UniqueName: \"kubernetes.io/projected/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-kube-api-access-sknxp\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:22.330329 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.330323    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsbqd\" (UniqueName: \"kubernetes.io/projected/60cd2d00-c86c-4856-86aa-d975464aedbf-kube-api-access-fsbqd\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:22.330329 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.330334    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:22.330553 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.330344    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:22.330553 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.330352    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:22.515436 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.515327    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-util" (OuterVolumeSpecName: "util") pod "60cd2d00-c86c-4856-86aa-d975464aedbf" (UID: "60cd2d00-c86c-4856-86aa-d975464aedbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:22.531381 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.531335    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60cd2d00-c86c-4856-86aa-d975464aedbf-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:22.938563 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.938523    2581 generic.go:356] "Generic (PLEG): container finished" podID="541719ed-e276-466c-9b19-bcf112e7e834" containerID="9dd2b8487eab608a48b952e8a79437f32b8e113a1e80959085240807a37ca7da" exitCode=0
Sep 08 15:50:22.939013 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.938618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4" event={"ID":"541719ed-e276-466c-9b19-bcf112e7e834","Type":"ContainerDied","Data":"9dd2b8487eab608a48b952e8a79437f32b8e113a1e80959085240807a37ca7da"}
Sep 08 15:50:22.940567 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.940540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7" event={"ID":"ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37","Type":"ContainerDied","Data":"76a67f502fd3b4a9a93d8b971bfadf9c29ecb9994f20f5a317453a4bfa987140"}
Sep 08 15:50:22.940665 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.940585    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76a67f502fd3b4a9a93d8b971bfadf9c29ecb9994f20f5a317453a4bfa987140"
Sep 08 15:50:22.940665 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.940547    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053b6rb7"
Sep 08 15:50:22.942555 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.942523    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc" event={"ID":"60cd2d00-c86c-4856-86aa-d975464aedbf","Type":"ContainerDied","Data":"b2b281e694a801aa0731d3413d480a4f337b552932b1ebeed30c23c6d461b2df"}
Sep 08 15:50:22.942719 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.942569    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2b281e694a801aa0731d3413d480a4f337b552932b1ebeed30c23c6d461b2df"
Sep 08 15:50:22.942719 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:22.942572    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbv89fc"
Sep 08 15:50:24.080761 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.080729    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:24.247032 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.246915    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x68c6\" (UniqueName: \"kubernetes.io/projected/541719ed-e276-466c-9b19-bcf112e7e834-kube-api-access-x68c6\") pod \"541719ed-e276-466c-9b19-bcf112e7e834\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") "
Sep 08 15:50:24.247032 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.246982    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-bundle\") pod \"541719ed-e276-466c-9b19-bcf112e7e834\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") "
Sep 08 15:50:24.247032 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.247006    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-util\") pod \"541719ed-e276-466c-9b19-bcf112e7e834\" (UID: \"541719ed-e276-466c-9b19-bcf112e7e834\") "
Sep 08 15:50:24.247464 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.247426    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-bundle" (OuterVolumeSpecName: "bundle") pod "541719ed-e276-466c-9b19-bcf112e7e834" (UID: "541719ed-e276-466c-9b19-bcf112e7e834"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:24.249076 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.249052    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/541719ed-e276-466c-9b19-bcf112e7e834-kube-api-access-x68c6" (OuterVolumeSpecName: "kube-api-access-x68c6") pod "541719ed-e276-466c-9b19-bcf112e7e834" (UID: "541719ed-e276-466c-9b19-bcf112e7e834"). InnerVolumeSpecName "kube-api-access-x68c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:50:24.251537 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.251495    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-util" (OuterVolumeSpecName: "util") pod "541719ed-e276-466c-9b19-bcf112e7e834" (UID: "541719ed-e276-466c-9b19-bcf112e7e834"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:24.348507 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.348460    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x68c6\" (UniqueName: \"kubernetes.io/projected/541719ed-e276-466c-9b19-bcf112e7e834-kube-api-access-x68c6\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:24.348507 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.348496    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:24.348507 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.348505    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/541719ed-e276-466c-9b19-bcf112e7e834-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:24.953751 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.953711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4" event={"ID":"541719ed-e276-466c-9b19-bcf112e7e834","Type":"ContainerDied","Data":"8a0ce66e177bcdbf3062765c0c85a2d12ff512ce54d26d97832b12a9da120712"}
Sep 08 15:50:24.953751 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.953748    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ncf4"
Sep 08 15:50:24.953977 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:24.953768    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a0ce66e177bcdbf3062765c0c85a2d12ff512ce54d26d97832b12a9da120712"
Sep 08 15:50:27.971328 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:27.971290    2581 generic.go:356] "Generic (PLEG): container finished" podID="2c954035-6107-415f-b571-dc383bb19b82" containerID="e7c8120a2f85499cdf494b29bd51740139ad661ed475781591c522e211ab0d04" exitCode=0
Sep 08 15:50:27.971693 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:27.971341    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv" event={"ID":"2c954035-6107-415f-b571-dc383bb19b82","Type":"ContainerDied","Data":"e7c8120a2f85499cdf494b29bd51740139ad661ed475781591c522e211ab0d04"}
Sep 08 15:50:28.979282 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:28.979249    2581 generic.go:356] "Generic (PLEG): container finished" podID="2c954035-6107-415f-b571-dc383bb19b82" containerID="5a98a1d3839defcc79ab623e9bf122bb3ae8251fe94ea175e58c8e7cca260e69" exitCode=0
Sep 08 15:50:28.979755 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:28.979330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv" event={"ID":"2c954035-6107-415f-b571-dc383bb19b82","Type":"ContainerDied","Data":"5a98a1d3839defcc79ab623e9bf122bb3ae8251fe94ea175e58c8e7cca260e69"}
Sep 08 15:50:30.120309 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.120272    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:30.142111 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.142076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:30.202748 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.202715    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:30.299083 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.298984    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-bundle\") pod \"2c954035-6107-415f-b571-dc383bb19b82\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") "
Sep 08 15:50:30.299083 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.299042    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkzv2\" (UniqueName: \"kubernetes.io/projected/2c954035-6107-415f-b571-dc383bb19b82-kube-api-access-mkzv2\") pod \"2c954035-6107-415f-b571-dc383bb19b82\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") "
Sep 08 15:50:30.299083 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.299081    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-util\") pod \"2c954035-6107-415f-b571-dc383bb19b82\" (UID: \"2c954035-6107-415f-b571-dc383bb19b82\") "
Sep 08 15:50:30.299594 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.299565    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-bundle" (OuterVolumeSpecName: "bundle") pod "2c954035-6107-415f-b571-dc383bb19b82" (UID: "2c954035-6107-415f-b571-dc383bb19b82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:30.301317 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.301285    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c954035-6107-415f-b571-dc383bb19b82-kube-api-access-mkzv2" (OuterVolumeSpecName: "kube-api-access-mkzv2") pod "2c954035-6107-415f-b571-dc383bb19b82" (UID: "2c954035-6107-415f-b571-dc383bb19b82"). InnerVolumeSpecName "kube-api-access-mkzv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:50:30.303892 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.303858    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-util" (OuterVolumeSpecName: "util") pod "2c954035-6107-415f-b571-dc383bb19b82" (UID: "2c954035-6107-415f-b571-dc383bb19b82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:30.400175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.400134    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.400175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.400166    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c954035-6107-415f-b571-dc383bb19b82-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.400175 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.400176    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkzv2\" (UniqueName: \"kubernetes.io/projected/2c954035-6107-415f-b571-dc383bb19b82-kube-api-access-mkzv2\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.997815 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.997779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv" event={"ID":"2c954035-6107-415f-b571-dc383bb19b82","Type":"ContainerDied","Data":"21cc040ef78aceaa6739b1fe8e078e6636bf2d96e3033d88e788656161d572d5"}
Sep 08 15:50:30.998000 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.997844    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21cc040ef78aceaa6739b1fe8e078e6636bf2d96e3033d88e788656161d572d5"
Sep 08 15:50:30.998000 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:30.997844    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c85pxv"
Sep 08 15:50:32.570020 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:32.569986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:32.624621 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:32.624588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:38.445814 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:38.445769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:39.251169 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:39.251128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:40.700912 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:40.700873    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-965dbc75-rt8x8"]
Sep 08 15:50:40.821171 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:40.821137    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:40.921147 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:40.921108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:40.987521 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:40.987441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:41.715886 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.715853    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c97k4"]
Sep 08 15:50:41.716247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716191    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60cd2d00-c86c-4856-86aa-d975464aedbf" containerName="util"
Sep 08 15:50:41.716247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716204    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60cd2d00-c86c-4856-86aa-d975464aedbf" containerName="util"
Sep 08 15:50:41.716247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716213    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" containerName="pull"
Sep 08 15:50:41.716247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716218    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" containerName="pull"
Sep 08 15:50:41.716247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716224    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c954035-6107-415f-b571-dc383bb19b82" containerName="pull"
Sep 08 15:50:41.716247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716230    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c954035-6107-415f-b571-dc383bb19b82" containerName="pull"
Sep 08 15:50:41.716247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716237    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" containerName="util"
Sep 08 15:50:41.716247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716241    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" containerName="util"
Sep 08 15:50:41.716247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716246    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541719ed-e276-466c-9b19-bcf112e7e834" containerName="pull"
Sep 08 15:50:41.716247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716251    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="541719ed-e276-466c-9b19-bcf112e7e834" containerName="pull"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716260    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60cd2d00-c86c-4856-86aa-d975464aedbf" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716265    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60cd2d00-c86c-4856-86aa-d975464aedbf" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716272    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60cd2d00-c86c-4856-86aa-d975464aedbf" containerName="pull"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716278    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60cd2d00-c86c-4856-86aa-d975464aedbf" containerName="pull"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716287    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541719ed-e276-466c-9b19-bcf112e7e834" containerName="util"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716292    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="541719ed-e276-466c-9b19-bcf112e7e834" containerName="util"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716299    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541719ed-e276-466c-9b19-bcf112e7e834" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716303    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="541719ed-e276-466c-9b19-bcf112e7e834" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716311    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c954035-6107-415f-b571-dc383bb19b82" containerName="util"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716316    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c954035-6107-415f-b571-dc383bb19b82" containerName="util"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716322    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c954035-6107-415f-b571-dc383bb19b82" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716326    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c954035-6107-415f-b571-dc383bb19b82" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716335    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716340    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716389    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="60cd2d00-c86c-4856-86aa-d975464aedbf" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716400    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="541719ed-e276-466c-9b19-bcf112e7e834" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716406    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c954035-6107-415f-b571-dc383bb19b82" containerName="extract"
Sep 08 15:50:41.716545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.716411    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec1e9fb5-8a75-43c3-9ef8-afc95ab14d37" containerName="extract"
Sep 08 15:50:41.719560 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.719543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4"
Sep 08 15:50:41.722392 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.722354    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lrbxw\""
Sep 08 15:50:41.722392 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.722357    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 15:50:41.722599 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.722454    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 15:50:41.731562 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.731536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c97k4"]
Sep 08 15:50:41.795132 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.795084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7jlv\" (UniqueName: \"kubernetes.io/projected/b949f4d2-204d-4dae-b944-5b826940c1f0-kube-api-access-m7jlv\") pod \"authorino-operator-68d88948d8-c97k4\" (UID: \"b949f4d2-204d-4dae-b944-5b826940c1f0\") " pod="kuadrant-system/authorino-operator-68d88948d8-c97k4"
Sep 08 15:50:41.896388 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.896344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7jlv\" (UniqueName: \"kubernetes.io/projected/b949f4d2-204d-4dae-b944-5b826940c1f0-kube-api-access-m7jlv\") pod \"authorino-operator-68d88948d8-c97k4\" (UID: \"b949f4d2-204d-4dae-b944-5b826940c1f0\") " pod="kuadrant-system/authorino-operator-68d88948d8-c97k4"
Sep 08 15:50:41.907954 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:41.907920    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7jlv\" (UniqueName: \"kubernetes.io/projected/b949f4d2-204d-4dae-b944-5b826940c1f0-kube-api-access-m7jlv\") pod \"authorino-operator-68d88948d8-c97k4\" (UID: \"b949f4d2-204d-4dae-b944-5b826940c1f0\") " pod="kuadrant-system/authorino-operator-68d88948d8-c97k4"
Sep 08 15:50:42.029956 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:42.029860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4"
Sep 08 15:50:42.324915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:42.324832    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c97k4"]
Sep 08 15:50:42.328144 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:50:42.328113    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb949f4d2_204d_4dae_b944_5b826940c1f0.slice/crio-8bdc2f085bfe8aa655eb2d700e3e99647bf971afb1dd0bff87add1bfc9ded8d7 WatchSource:0}: Error finding container 8bdc2f085bfe8aa655eb2d700e3e99647bf971afb1dd0bff87add1bfc9ded8d7: Status 404 returned error can't find the container with id 8bdc2f085bfe8aa655eb2d700e3e99647bf971afb1dd0bff87add1bfc9ded8d7
Sep 08 15:50:42.367811 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:42.367773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:42.470096 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:42.470058    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:42.569001 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:42.568965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:43.058153 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:43.058117    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4" event={"ID":"b949f4d2-204d-4dae-b944-5b826940c1f0","Type":"ContainerStarted","Data":"8bdc2f085bfe8aa655eb2d700e3e99647bf971afb1dd0bff87add1bfc9ded8d7"}
Sep 08 15:50:44.519845 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:44.519764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:45.069629 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:45.069529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4" event={"ID":"b949f4d2-204d-4dae-b944-5b826940c1f0","Type":"ContainerStarted","Data":"4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b"}
Sep 08 15:50:45.069629 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:45.069591    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4"
Sep 08 15:50:45.090733 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:45.090679    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4" podStartSLOduration=1.636990535 podStartE2EDuration="4.09066134s" totalImagesPullingTime="2.453670805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:50:45.089007628 +0000 UTC m=+373.211163244" watchObservedRunningTime="2026-09-08 15:50:45.09066134 +0000 UTC m=+373.212816955"
Sep 08 15:50:46.352492 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:46.352454    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:46.644241 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:46.644148    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:46.906004 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:46.905969    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:47.066620 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:47.066583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:47.658253 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:47.658217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:48.126047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:48.125945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:48.222004 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:48.221971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:50.646577 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.646530    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"]
Sep 08 15:50:50.650393 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.650367    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:50:50.653495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.653472    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t8mht\""
Sep 08 15:50:50.664088 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.664050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r76t7\" (UniqueName: \"kubernetes.io/projected/c2d09a30-1131-43a5-95db-d6f0f586e3e7-kube-api-access-r76t7\") pod \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" (UID: \"c2d09a30-1131-43a5-95db-d6f0f586e3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:50:50.664224 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.664119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2d09a30-1131-43a5-95db-d6f0f586e3e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" (UID: \"c2d09a30-1131-43a5-95db-d6f0f586e3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:50:50.686090 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.686059    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"]
Sep 08 15:50:50.765273 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.765231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76t7\" (UniqueName: \"kubernetes.io/projected/c2d09a30-1131-43a5-95db-d6f0f586e3e7-kube-api-access-r76t7\") pod \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" (UID: \"c2d09a30-1131-43a5-95db-d6f0f586e3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:50:50.765456 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.765305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2d09a30-1131-43a5-95db-d6f0f586e3e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" (UID: \"c2d09a30-1131-43a5-95db-d6f0f586e3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:50:50.765707 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.765683    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2d09a30-1131-43a5-95db-d6f0f586e3e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" (UID: \"c2d09a30-1131-43a5-95db-d6f0f586e3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:50:50.779782 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.779754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r76t7\" (UniqueName: \"kubernetes.io/projected/c2d09a30-1131-43a5-95db-d6f0f586e3e7-kube-api-access-r76t7\") pod \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" (UID: \"c2d09a30-1131-43a5-95db-d6f0f586e3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:50:50.960051 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:50.960013    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:50:51.238158 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:51.238130    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"]
Sep 08 15:50:51.239750 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:50:51.239720    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d09a30_1131_43a5_95db_d6f0f586e3e7.slice/crio-ac28c74ba108304ce08a8ec2a5ca1452937e124616f4b658d62c6a8609de780a WatchSource:0}: Error finding container ac28c74ba108304ce08a8ec2a5ca1452937e124616f4b658d62c6a8609de780a: Status 404 returned error can't find the container with id ac28c74ba108304ce08a8ec2a5ca1452937e124616f4b658d62c6a8609de780a
Sep 08 15:50:52.107960 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:52.107910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49" event={"ID":"c2d09a30-1131-43a5-95db-d6f0f586e3e7","Type":"ContainerStarted","Data":"ac28c74ba108304ce08a8ec2a5ca1452937e124616f4b658d62c6a8609de780a"}
Sep 08 15:50:53.757481 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:53.757441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:53.859213 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:53.859164    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:56.076932 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:56.076900    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4"
Sep 08 15:50:56.133741 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:56.133702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49" event={"ID":"c2d09a30-1131-43a5-95db-d6f0f586e3e7","Type":"ContainerStarted","Data":"5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8"}
Sep 08 15:50:56.133948 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:56.133803    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:50:56.155545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:56.155489    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49" podStartSLOduration=2.023521752 podStartE2EDuration="6.155470937s" totalImagesPullingTime="4.131949185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:50:56.153757439 +0000 UTC m=+384.275913054" watchObservedRunningTime="2026-09-08 15:50:56.155470937 +0000 UTC m=+384.277626629"
Sep 08 15:50:56.267549 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:56.267515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:56.369635 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:56.369556    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:57.843217 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:57.843181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:57.902126 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:57.902092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:58.064865 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:58.064812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:58.306478 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:50:58.306445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:04.291195 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:04.291156    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:04.392285 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:04.392256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:05.720636 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.720593    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-965dbc75-rt8x8" podUID="3d303933-aabb-4316-b057-3aff11ad6425" containerName="console" containerID="cri-o://3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254" gracePeriod=15
Sep 08 15:51:05.887101 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.887059    2581 patch_prober.go:28] interesting pod/console-965dbc75-rt8x8 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" start-of-body=
Sep 08 15:51:05.887266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.887139    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-965dbc75-rt8x8" podUID="3d303933-aabb-4316-b057-3aff11ad6425" containerName="console" probeResult="failure" output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused"
Sep 08 15:51:05.963518 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.963490    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:51:05.999387 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.999294    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-oauth-config\") pod \"3d303933-aabb-4316-b057-3aff11ad6425\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") "
Sep 08 15:51:05.999387 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.999337    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-oauth-serving-cert\") pod \"3d303933-aabb-4316-b057-3aff11ad6425\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") "
Sep 08 15:51:05.999387 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.999374    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbpqq\" (UniqueName: \"kubernetes.io/projected/3d303933-aabb-4316-b057-3aff11ad6425-kube-api-access-kbpqq\") pod \"3d303933-aabb-4316-b057-3aff11ad6425\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") "
Sep 08 15:51:05.999663 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.999414    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-trusted-ca-bundle\") pod \"3d303933-aabb-4316-b057-3aff11ad6425\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") "
Sep 08 15:51:05.999663 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.999434    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-serving-cert\") pod \"3d303933-aabb-4316-b057-3aff11ad6425\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") "
Sep 08 15:51:05.999663 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.999495    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-service-ca\") pod \"3d303933-aabb-4316-b057-3aff11ad6425\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") "
Sep 08 15:51:05.999663 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.999521    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-console-config\") pod \"3d303933-aabb-4316-b057-3aff11ad6425\" (UID: \"3d303933-aabb-4316-b057-3aff11ad6425\") "
Sep 08 15:51:05.999911 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.999768    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d303933-aabb-4316-b057-3aff11ad6425" (UID: "3d303933-aabb-4316-b057-3aff11ad6425"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:51:05.999911 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:05.999879    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d303933-aabb-4316-b057-3aff11ad6425" (UID: "3d303933-aabb-4316-b057-3aff11ad6425"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:51:06.000144 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.000121    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-console-config" (OuterVolumeSpecName: "console-config") pod "3d303933-aabb-4316-b057-3aff11ad6425" (UID: "3d303933-aabb-4316-b057-3aff11ad6425"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:51:06.000242 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.000198    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d303933-aabb-4316-b057-3aff11ad6425" (UID: "3d303933-aabb-4316-b057-3aff11ad6425"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:51:06.001740 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.001708    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d303933-aabb-4316-b057-3aff11ad6425-kube-api-access-kbpqq" (OuterVolumeSpecName: "kube-api-access-kbpqq") pod "3d303933-aabb-4316-b057-3aff11ad6425" (UID: "3d303933-aabb-4316-b057-3aff11ad6425"). InnerVolumeSpecName "kube-api-access-kbpqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:51:06.001879 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.001741    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d303933-aabb-4316-b057-3aff11ad6425" (UID: "3d303933-aabb-4316-b057-3aff11ad6425"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:51:06.001879 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.001803    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d303933-aabb-4316-b057-3aff11ad6425" (UID: "3d303933-aabb-4316-b057-3aff11ad6425"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:51:06.100881 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.100840    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-oauth-serving-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:06.100881 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.100872    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbpqq\" (UniqueName: \"kubernetes.io/projected/3d303933-aabb-4316-b057-3aff11ad6425-kube-api-access-kbpqq\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:06.100881 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.100882    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-trusted-ca-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:06.100881 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.100891    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-serving-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:06.101143 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.100899    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:06.101143 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.100908    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d303933-aabb-4316-b057-3aff11ad6425-console-config\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:06.101143 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.100915    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d303933-aabb-4316-b057-3aff11ad6425-console-oauth-config\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:06.186767 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.186726    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d303933-aabb-4316-b057-3aff11ad6425" containerID="3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254" exitCode=0
Sep 08 15:51:06.186767 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.186772    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-965dbc75-rt8x8"
Sep 08 15:51:06.187065 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.186834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-965dbc75-rt8x8" event={"ID":"3d303933-aabb-4316-b057-3aff11ad6425","Type":"ContainerDied","Data":"3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254"}
Sep 08 15:51:06.187065 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.186905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-965dbc75-rt8x8" event={"ID":"3d303933-aabb-4316-b057-3aff11ad6425","Type":"ContainerDied","Data":"4ac908c3c0e76e22d1a9dea005c1063e6282848cc81a90a01addd9d1e23b10b6"}
Sep 08 15:51:06.187065 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.186935    2581 scope.go:117] "RemoveContainer" containerID="3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254"
Sep 08 15:51:06.196594 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.196573    2581 scope.go:117] "RemoveContainer" containerID="3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254"
Sep 08 15:51:06.196949 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:06.196928    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254\": container with ID starting with 3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254 not found: ID does not exist" containerID="3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254"
Sep 08 15:51:06.197063 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.196958    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254"} err="failed to get container status \"3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254\": rpc error: code = NotFound desc = could not find container \"3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254\": container with ID starting with 3f9583f0b74987f0698a4d04632d03a86813abfb29cedf4955b8c8f08daa8254 not found: ID does not exist"
Sep 08 15:51:06.210897 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.210850    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-965dbc75-rt8x8"]
Sep 08 15:51:06.216104 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.216071    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-965dbc75-rt8x8"]
Sep 08 15:51:06.365732 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:06.365647    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d303933-aabb-4316-b057-3aff11ad6425" path="/var/lib/kubelet/pods/3d303933-aabb-4316-b057-3aff11ad6425/volumes"
Sep 08 15:51:07.141838 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:07.141782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:51:08.449290 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.449251    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"]
Sep 08 15:51:08.449789 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.449746    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d303933-aabb-4316-b057-3aff11ad6425" containerName="console"
Sep 08 15:51:08.449789 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.449768    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d303933-aabb-4316-b057-3aff11ad6425" containerName="console"
Sep 08 15:51:08.449941 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.449876    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d303933-aabb-4316-b057-3aff11ad6425" containerName="console"
Sep 08 15:51:08.454357 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.454326    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:08.465439 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.465410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"]
Sep 08 15:51:08.523695 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.523660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr468\" (UniqueName: \"kubernetes.io/projected/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-kube-api-access-lr468\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cxmwd\" (UID: \"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:08.523923 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.523724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cxmwd\" (UID: \"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:08.625105 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.625062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr468\" (UniqueName: \"kubernetes.io/projected/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-kube-api-access-lr468\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cxmwd\" (UID: \"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:08.625281 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.625132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cxmwd\" (UID: \"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:08.625543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.625519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cxmwd\" (UID: \"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:08.634112 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.634084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr468\" (UniqueName: \"kubernetes.io/projected/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-kube-api-access-lr468\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cxmwd\" (UID: \"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:08.765430 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:08.765335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:09.061750 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.061646    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"]
Sep 08 15:51:09.064768 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:51:09.064736    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c40e59b_ffb4_42e7_86e0_3fa7a4bd0b9f.slice/crio-8c7abb24f05daae563be427f4f167771f1ce366f9696ef86629109730eb0f39c WatchSource:0}: Error finding container 8c7abb24f05daae563be427f4f167771f1ce366f9696ef86629109730eb0f39c: Status 404 returned error can't find the container with id 8c7abb24f05daae563be427f4f167771f1ce366f9696ef86629109730eb0f39c
Sep 08 15:51:09.206363 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.206321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd" event={"ID":"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f","Type":"ContainerStarted","Data":"83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188"}
Sep 08 15:51:09.206557 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.206377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd" event={"ID":"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f","Type":"ContainerStarted","Data":"8c7abb24f05daae563be427f4f167771f1ce366f9696ef86629109730eb0f39c"}
Sep 08 15:51:09.206557 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.206419    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:09.226692 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.226632    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd" podStartSLOduration=1.226611968 podStartE2EDuration="1.226611968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:51:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:51:09.225977062 +0000 UTC m=+397.348132678" watchObservedRunningTime="2026-09-08 15:51:09.226611968 +0000 UTC m=+397.348767583"
Sep 08 15:51:09.279496 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.279447    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"]
Sep 08 15:51:09.279697 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.279666    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49" podUID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" containerName="manager" containerID="cri-o://5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8" gracePeriod=2
Sep 08 15:51:09.284524 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.284479    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"]
Sep 08 15:51:09.294390 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.294308    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"]
Sep 08 15:51:09.305730 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.305703    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"]
Sep 08 15:51:09.307198 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.306142    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" containerName="manager"
Sep 08 15:51:09.307198 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.306167    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" containerName="manager"
Sep 08 15:51:09.307198 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.306257    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" containerName="manager"
Sep 08 15:51:09.314244 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.313555    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:09.314428 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.314408    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"]
Sep 08 15:51:09.331073 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:09.331011    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:51:09.337330 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.337259    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"]
Sep 08 15:51:09.337863 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.337842    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" containerName="manager"
Sep 08 15:51:09.337863 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.337866    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" containerName="manager"
Sep 08 15:51:09.338044 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.338000    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" containerName="manager"
Sep 08 15:51:09.346036 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.345938    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:09.346186 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.346102    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"]
Sep 08 15:51:09.347551 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.347507    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"]
Sep 08 15:51:09.355139 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:09.355100    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:51:09.431266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.430958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9a4f489-1972-46a1-93e2-7112add77232-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dj2pl\" (UID: \"d9a4f489-1972-46a1-93e2-7112add77232\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:09.431266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.431065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08f486b3-92e0-4adc-995a-93ab4cd15e5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-9wvtg\" (UID: \"08f486b3-92e0-4adc-995a-93ab4cd15e5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:09.431266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.431097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bg5b\" (UniqueName: \"kubernetes.io/projected/d9a4f489-1972-46a1-93e2-7112add77232-kube-api-access-4bg5b\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dj2pl\" (UID: \"d9a4f489-1972-46a1-93e2-7112add77232\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:09.431266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.431141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxzz\" (UniqueName: \"kubernetes.io/projected/08f486b3-92e0-4adc-995a-93ab4cd15e5d-kube-api-access-2cxzz\") pod \"kuadrant-operator-controller-manager-58fc56757c-9wvtg\" (UID: \"08f486b3-92e0-4adc-995a-93ab4cd15e5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:09.518161 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.518132    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:51:09.520007 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:09.519972    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:51:09.531902 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.531868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08f486b3-92e0-4adc-995a-93ab4cd15e5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-9wvtg\" (UID: \"08f486b3-92e0-4adc-995a-93ab4cd15e5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:09.531902 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.531908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bg5b\" (UniqueName: \"kubernetes.io/projected/d9a4f489-1972-46a1-93e2-7112add77232-kube-api-access-4bg5b\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dj2pl\" (UID: \"d9a4f489-1972-46a1-93e2-7112add77232\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:09.532119 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.531935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxzz\" (UniqueName: \"kubernetes.io/projected/08f486b3-92e0-4adc-995a-93ab4cd15e5d-kube-api-access-2cxzz\") pod \"kuadrant-operator-controller-manager-58fc56757c-9wvtg\" (UID: \"08f486b3-92e0-4adc-995a-93ab4cd15e5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:09.532165 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.532118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9a4f489-1972-46a1-93e2-7112add77232-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dj2pl\" (UID: \"d9a4f489-1972-46a1-93e2-7112add77232\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:09.532370 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.532350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08f486b3-92e0-4adc-995a-93ab4cd15e5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-9wvtg\" (UID: \"08f486b3-92e0-4adc-995a-93ab4cd15e5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:09.532549 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.532529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9a4f489-1972-46a1-93e2-7112add77232-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dj2pl\" (UID: \"d9a4f489-1972-46a1-93e2-7112add77232\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:09.547444 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.547410    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxzz\" (UniqueName: \"kubernetes.io/projected/08f486b3-92e0-4adc-995a-93ab4cd15e5d-kube-api-access-2cxzz\") pod \"kuadrant-operator-controller-manager-58fc56757c-9wvtg\" (UID: \"08f486b3-92e0-4adc-995a-93ab4cd15e5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:09.547996 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.547974    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bg5b\" (UniqueName: \"kubernetes.io/projected/d9a4f489-1972-46a1-93e2-7112add77232-kube-api-access-4bg5b\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dj2pl\" (UID: \"d9a4f489-1972-46a1-93e2-7112add77232\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:09.633041 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.632951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2d09a30-1131-43a5-95db-d6f0f586e3e7-extensions-socket-volume\") pod \"c2d09a30-1131-43a5-95db-d6f0f586e3e7\" (UID: \"c2d09a30-1131-43a5-95db-d6f0f586e3e7\") "
Sep 08 15:51:09.633041 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.632997    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r76t7\" (UniqueName: \"kubernetes.io/projected/c2d09a30-1131-43a5-95db-d6f0f586e3e7-kube-api-access-r76t7\") pod \"c2d09a30-1131-43a5-95db-d6f0f586e3e7\" (UID: \"c2d09a30-1131-43a5-95db-d6f0f586e3e7\") "
Sep 08 15:51:09.633440 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.633405    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d09a30-1131-43a5-95db-d6f0f586e3e7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c2d09a30-1131-43a5-95db-d6f0f586e3e7" (UID: "c2d09a30-1131-43a5-95db-d6f0f586e3e7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:51:09.635300 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.635271    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d09a30-1131-43a5-95db-d6f0f586e3e7-kube-api-access-r76t7" (OuterVolumeSpecName: "kube-api-access-r76t7") pod "c2d09a30-1131-43a5-95db-d6f0f586e3e7" (UID: "c2d09a30-1131-43a5-95db-d6f0f586e3e7"). InnerVolumeSpecName "kube-api-access-r76t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:51:09.657520 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.657480    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:09.664778 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.664745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:09.734417 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.734379    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2d09a30-1131-43a5-95db-d6f0f586e3e7-extensions-socket-volume\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:09.734417 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.734417    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r76t7\" (UniqueName: \"kubernetes.io/projected/c2d09a30-1131-43a5-95db-d6f0f586e3e7-kube-api-access-r76t7\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:09.944181 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.943995    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"]
Sep 08 15:51:09.947237 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:51:09.947207    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f486b3_92e0_4adc_995a_93ab4cd15e5d.slice/crio-c2ad3a6ffad063a3a6c4953152297671303061cacad2896f29f6c3dec8399053 WatchSource:0}: Error finding container c2ad3a6ffad063a3a6c4953152297671303061cacad2896f29f6c3dec8399053: Status 404 returned error can't find the container with id c2ad3a6ffad063a3a6c4953152297671303061cacad2896f29f6c3dec8399053
Sep 08 15:51:09.952085 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:09.952062    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"]
Sep 08 15:51:09.953983 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:51:09.953957    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a4f489_1972_46a1_93e2_7112add77232.slice/crio-68cc0de3244f5c3addf72a23291b5d0cc15e2c68ed201a36ebaecee538e609fc WatchSource:0}: Error finding container 68cc0de3244f5c3addf72a23291b5d0cc15e2c68ed201a36ebaecee538e609fc: Status 404 returned error can't find the container with id 68cc0de3244f5c3addf72a23291b5d0cc15e2c68ed201a36ebaecee538e609fc
Sep 08 15:51:10.214043 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.213947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg" event={"ID":"08f486b3-92e0-4adc-995a-93ab4cd15e5d","Type":"ContainerStarted","Data":"8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51"}
Sep 08 15:51:10.214218 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.214130    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:10.214218 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.214165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg" event={"ID":"08f486b3-92e0-4adc-995a-93ab4cd15e5d","Type":"ContainerStarted","Data":"c2ad3a6ffad063a3a6c4953152297671303061cacad2896f29f6c3dec8399053"}
Sep 08 15:51:10.215748 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.215725    2581 generic.go:356] "Generic (PLEG): container finished" podID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" containerID="5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8" exitCode=0
Sep 08 15:51:10.215889 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.215769    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:51:10.215889 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.215802    2581 scope.go:117] "RemoveContainer" containerID="5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8"
Sep 08 15:51:10.217970 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.217942    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl" event={"ID":"d9a4f489-1972-46a1-93e2-7112add77232","Type":"ContainerStarted","Data":"532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a"}
Sep 08 15:51:10.218107 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.217994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl" event={"ID":"d9a4f489-1972-46a1-93e2-7112add77232","Type":"ContainerStarted","Data":"68cc0de3244f5c3addf72a23291b5d0cc15e2c68ed201a36ebaecee538e609fc"}
Sep 08 15:51:10.218107 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.218087    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:10.218343 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:10.218327    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd" container="manager"
Sep 08 15:51:10.229519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.228904    2581 scope.go:117] "RemoveContainer" containerID="5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8"
Sep 08 15:51:10.230215 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:10.230188    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8\": container with ID starting with 5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8 not found: ID does not exist" containerID="5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8"
Sep 08 15:51:10.230366 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.230224    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8"} err="failed to get container status \"5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8\": rpc error: code = NotFound desc = could not find container \"5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8\": container with ID starting with 5414e6d4ecfc3d4b48878f096b754b320ce46194448f4a8db5a7a402ecc46dc8 not found: ID does not exist"
Sep 08 15:51:10.235693 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:10.235464    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:51:10.236788 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.236738    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg" podStartSLOduration=1.23672015 podStartE2EDuration="1.23672015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:51:10.233683795 +0000 UTC m=+398.355839409" watchObservedRunningTime="2026-09-08 15:51:10.23672015 +0000 UTC m=+398.358875766"
Sep 08 15:51:10.237247 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:10.237204    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cxmwd\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:10.238837 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:10.238795    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-bdc49\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-bdc49"
Sep 08 15:51:10.263785 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.263719    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl" podStartSLOduration=1.2637015329999999 podStartE2EDuration="1.263701533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:51:10.262121772 +0000 UTC m=+398.384277389" watchObservedRunningTime="2026-09-08 15:51:10.263701533 +0000 UTC m=+398.385857147"
Sep 08 15:51:10.366191 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:10.366151    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2d09a30-1131-43a5-95db-d6f0f586e3e7" path="/var/lib/kubelet/pods/c2d09a30-1131-43a5-95db-d6f0f586e3e7/volumes"
Sep 08 15:51:11.227491 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:11.227434    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd" podUID="5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" containerName="manager" containerID="cri-o://83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188" gracePeriod=2
Sep 08 15:51:11.474086 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:11.474054    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:11.552530 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:11.552432    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr468\" (UniqueName: \"kubernetes.io/projected/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-kube-api-access-lr468\") pod \"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f\" (UID: \"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f\") "
Sep 08 15:51:11.552678 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:11.552546    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-extensions-socket-volume\") pod \"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f\" (UID: \"5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f\") "
Sep 08 15:51:11.552803 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:11.552776    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" (UID: "5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:51:11.554568 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:11.554540    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-kube-api-access-lr468" (OuterVolumeSpecName: "kube-api-access-lr468") pod "5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" (UID: "5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f"). InnerVolumeSpecName "kube-api-access-lr468". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:51:11.653915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:11.653874    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-extensions-socket-volume\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:11.653915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:11.653908    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr468\" (UniqueName: \"kubernetes.io/projected/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f-kube-api-access-lr468\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:12.234398 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:12.234358    2581 generic.go:356] "Generic (PLEG): container finished" podID="5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" containerID="83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188" exitCode=2
Sep 08 15:51:12.234398 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:12.234402    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:12.234984 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:12.234413    2581 scope.go:117] "RemoveContainer" containerID="83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188"
Sep 08 15:51:12.236608 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:12.236575    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cxmwd\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:12.244335 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:12.244310    2581 scope.go:117] "RemoveContainer" containerID="83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188"
Sep 08 15:51:12.244623 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:12.244602    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188\": container with ID starting with 83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188 not found: ID does not exist" containerID="83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188"
Sep 08 15:51:12.244674 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:12.244633    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188"} err="failed to get container status \"83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188\": rpc error: code = NotFound desc = could not find container \"83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188\": container with ID starting with 83c061cdd33f6f5c695cc835c58655d833abf56bf6c572e0fa6bb07572408188 not found: ID does not exist"
Sep 08 15:51:12.245561 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:12.245531    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cxmwd\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:12.294049 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:12.294012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:12.364813 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:12.364775    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cxmwd\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cxmwd"
Sep 08 15:51:12.366769 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:12.366745    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f" path="/var/lib/kubelet/pods/5c40e59b-ffb4-42e7-86e0-3fa7a4bd0b9f/volumes"
Sep 08 15:51:12.390498 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:12.390464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:12.919578 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:12.919541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:13.030896 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:13.030857    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:16.285710 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:16.285675    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:16.386131 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:16.386095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:18.519702 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:18.519669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:18.581548 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:18.581517    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:20.567407 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:20.567371    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:20.667492 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:20.667456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:21.230209 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.230181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:21.230409 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.230247    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:21.323413 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.323372    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"]
Sep 08 15:51:21.323617 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.323589    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg" podUID="08f486b3-92e0-4adc-995a-93ab4cd15e5d" containerName="manager" containerID="cri-o://8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51" gracePeriod=10
Sep 08 15:51:21.544532 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.544498    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"]
Sep 08 15:51:21.548741 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.548715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:51:21.573396 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.573361    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"]
Sep 08 15:51:21.579311 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.579286    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:21.637029 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.636997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkw2t\" (UniqueName: \"kubernetes.io/projected/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-kube-api-access-jkw2t\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hfbgb\" (UID: \"8cd6527c-f21d-4b94-87f6-2f4d9c19f085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:51:21.637196 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.637046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hfbgb\" (UID: \"8cd6527c-f21d-4b94-87f6-2f4d9c19f085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:51:21.738122 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.738082    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08f486b3-92e0-4adc-995a-93ab4cd15e5d-extensions-socket-volume\") pod \"08f486b3-92e0-4adc-995a-93ab4cd15e5d\" (UID: \"08f486b3-92e0-4adc-995a-93ab4cd15e5d\") "
Sep 08 15:51:21.738289 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.738215    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cxzz\" (UniqueName: \"kubernetes.io/projected/08f486b3-92e0-4adc-995a-93ab4cd15e5d-kube-api-access-2cxzz\") pod \"08f486b3-92e0-4adc-995a-93ab4cd15e5d\" (UID: \"08f486b3-92e0-4adc-995a-93ab4cd15e5d\") "
Sep 08 15:51:21.738412 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.738393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkw2t\" (UniqueName: \"kubernetes.io/projected/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-kube-api-access-jkw2t\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hfbgb\" (UID: \"8cd6527c-f21d-4b94-87f6-2f4d9c19f085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:51:21.738476 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.738444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hfbgb\" (UID: \"8cd6527c-f21d-4b94-87f6-2f4d9c19f085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:51:21.738476 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.738449    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08f486b3-92e0-4adc-995a-93ab4cd15e5d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "08f486b3-92e0-4adc-995a-93ab4cd15e5d" (UID: "08f486b3-92e0-4adc-995a-93ab4cd15e5d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:51:21.738578 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.738523    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08f486b3-92e0-4adc-995a-93ab4cd15e5d-extensions-socket-volume\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:21.738784 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.738765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hfbgb\" (UID: \"8cd6527c-f21d-4b94-87f6-2f4d9c19f085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:51:21.740300 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.740280    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f486b3-92e0-4adc-995a-93ab4cd15e5d-kube-api-access-2cxzz" (OuterVolumeSpecName: "kube-api-access-2cxzz") pod "08f486b3-92e0-4adc-995a-93ab4cd15e5d" (UID: "08f486b3-92e0-4adc-995a-93ab4cd15e5d"). InnerVolumeSpecName "kube-api-access-2cxzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:51:21.752732 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.752704    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkw2t\" (UniqueName: \"kubernetes.io/projected/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-kube-api-access-jkw2t\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hfbgb\" (UID: \"8cd6527c-f21d-4b94-87f6-2f4d9c19f085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:51:21.839849 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.839802    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cxzz\" (UniqueName: \"kubernetes.io/projected/08f486b3-92e0-4adc-995a-93ab4cd15e5d-kube-api-access-2cxzz\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:21.871760 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:21.871719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:51:22.156377 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.156353    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"]
Sep 08 15:51:22.159519 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:51:22.159490    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd6527c_f21d_4b94_87f6_2f4d9c19f085.slice/crio-f987f2452d5caf1ffba94fb9ba59c6f6115ff6f10d133d0cfcf541acb9718a74 WatchSource:0}: Error finding container f987f2452d5caf1ffba94fb9ba59c6f6115ff6f10d133d0cfcf541acb9718a74: Status 404 returned error can't find the container with id f987f2452d5caf1ffba94fb9ba59c6f6115ff6f10d133d0cfcf541acb9718a74
Sep 08 15:51:22.291543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.291504    2581 generic.go:356] "Generic (PLEG): container finished" podID="08f486b3-92e0-4adc-995a-93ab4cd15e5d" containerID="8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51" exitCode=0
Sep 08 15:51:22.291543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.291545    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"
Sep 08 15:51:22.291802 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.291583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg" event={"ID":"08f486b3-92e0-4adc-995a-93ab4cd15e5d","Type":"ContainerDied","Data":"8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51"}
Sep 08 15:51:22.291802 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.291633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg" event={"ID":"08f486b3-92e0-4adc-995a-93ab4cd15e5d","Type":"ContainerDied","Data":"c2ad3a6ffad063a3a6c4953152297671303061cacad2896f29f6c3dec8399053"}
Sep 08 15:51:22.291802 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.291662    2581 scope.go:117] "RemoveContainer" containerID="8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51"
Sep 08 15:51:22.293668 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.293645    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb" event={"ID":"8cd6527c-f21d-4b94-87f6-2f4d9c19f085","Type":"ContainerStarted","Data":"044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718"}
Sep 08 15:51:22.293797 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.293685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb" event={"ID":"8cd6527c-f21d-4b94-87f6-2f4d9c19f085","Type":"ContainerStarted","Data":"f987f2452d5caf1ffba94fb9ba59c6f6115ff6f10d133d0cfcf541acb9718a74"}
Sep 08 15:51:22.293797 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.293791    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:51:22.300929 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.300913    2581 scope.go:117] "RemoveContainer" containerID="8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51"
Sep 08 15:51:22.301225 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:22.301203    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51\": container with ID starting with 8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51 not found: ID does not exist" containerID="8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51"
Sep 08 15:51:22.301279 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.301233    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51"} err="failed to get container status \"8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51\": rpc error: code = NotFound desc = could not find container \"8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51\": container with ID starting with 8b979b67a4f83dd2a5563cce8e781b1e1932d87080789689bb113d3ab284fe51 not found: ID does not exist"
Sep 08 15:51:22.334251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.334197    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb" podStartSLOduration=1.334178835 podStartE2EDuration="1.334178835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:51:22.332074423 +0000 UTC m=+410.454230038" watchObservedRunningTime="2026-09-08 15:51:22.334178835 +0000 UTC m=+410.456334450"
Sep 08 15:51:22.357064 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.357031    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"]
Sep 08 15:51:22.368859 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:22.368808    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9wvtg"]
Sep 08 15:51:24.295583 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:24.295531    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:24.369984 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:24.369946    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08f486b3-92e0-4adc-995a-93ab4cd15e5d" path="/var/lib/kubelet/pods/08f486b3-92e0-4adc-995a-93ab4cd15e5d/volumes"
Sep 08 15:51:24.395160 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:24.395122    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:24.494924 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:24.494890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:33.303870 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:33.303835    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:51:33.358263 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:33.358227    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"]
Sep 08 15:51:33.358450 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:33.358426    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl" podUID="d9a4f489-1972-46a1-93e2-7112add77232" containerName="manager" containerID="cri-o://532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a" gracePeriod=10
Sep 08 15:51:33.611093 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:33.611064    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:33.739131 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:33.739095    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bg5b\" (UniqueName: \"kubernetes.io/projected/d9a4f489-1972-46a1-93e2-7112add77232-kube-api-access-4bg5b\") pod \"d9a4f489-1972-46a1-93e2-7112add77232\" (UID: \"d9a4f489-1972-46a1-93e2-7112add77232\") "
Sep 08 15:51:33.739332 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:33.739155    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9a4f489-1972-46a1-93e2-7112add77232-extensions-socket-volume\") pod \"d9a4f489-1972-46a1-93e2-7112add77232\" (UID: \"d9a4f489-1972-46a1-93e2-7112add77232\") "
Sep 08 15:51:33.739592 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:33.739563    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a4f489-1972-46a1-93e2-7112add77232-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d9a4f489-1972-46a1-93e2-7112add77232" (UID: "d9a4f489-1972-46a1-93e2-7112add77232"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:51:33.741562 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:33.741532    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9a4f489-1972-46a1-93e2-7112add77232-kube-api-access-4bg5b" (OuterVolumeSpecName: "kube-api-access-4bg5b") pod "d9a4f489-1972-46a1-93e2-7112add77232" (UID: "d9a4f489-1972-46a1-93e2-7112add77232"). InnerVolumeSpecName "kube-api-access-4bg5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:51:33.839641 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:33.839595    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bg5b\" (UniqueName: \"kubernetes.io/projected/d9a4f489-1972-46a1-93e2-7112add77232-kube-api-access-4bg5b\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:33.839641 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:33.839632    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9a4f489-1972-46a1-93e2-7112add77232-extensions-socket-volume\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:51:34.358423 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:34.358383    2581 generic.go:356] "Generic (PLEG): container finished" podID="d9a4f489-1972-46a1-93e2-7112add77232" containerID="532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a" exitCode=0
Sep 08 15:51:34.358423 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:34.358425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl" event={"ID":"d9a4f489-1972-46a1-93e2-7112add77232","Type":"ContainerDied","Data":"532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a"}
Sep 08 15:51:34.358963 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:34.358434    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"
Sep 08 15:51:34.358963 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:34.358465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl" event={"ID":"d9a4f489-1972-46a1-93e2-7112add77232","Type":"ContainerDied","Data":"68cc0de3244f5c3addf72a23291b5d0cc15e2c68ed201a36ebaecee538e609fc"}
Sep 08 15:51:34.358963 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:34.358487    2581 scope.go:117] "RemoveContainer" containerID="532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a"
Sep 08 15:51:34.368461 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:34.368439    2581 scope.go:117] "RemoveContainer" containerID="532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a"
Sep 08 15:51:34.368847 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:51:34.368790    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a\": container with ID starting with 532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a not found: ID does not exist" containerID="532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a"
Sep 08 15:51:34.368960 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:34.368861    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a"} err="failed to get container status \"532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a\": rpc error: code = NotFound desc = could not find container \"532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a\": container with ID starting with 532ba5a65872482e134824c463f70d03b921cf2162d8690cf2492c6fccbcd90a not found: ID does not exist"
Sep 08 15:51:34.385339 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:34.385298    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"]
Sep 08 15:51:34.388989 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:34.388956    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dj2pl"]
Sep 08 15:51:36.365441 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:36.365402    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9a4f489-1972-46a1-93e2-7112add77232" path="/var/lib/kubelet/pods/d9a4f489-1972-46a1-93e2-7112add77232/volumes"
Sep 08 15:51:37.683997 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:37.683952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:38.043724 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:38.043634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:51.255579 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.255538    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"]
Sep 08 15:51:51.256000 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.255880    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f486b3-92e0-4adc-995a-93ab4cd15e5d" containerName="manager"
Sep 08 15:51:51.256000 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.255891    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f486b3-92e0-4adc-995a-93ab4cd15e5d" containerName="manager"
Sep 08 15:51:51.256000 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.255905    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a4f489-1972-46a1-93e2-7112add77232" containerName="manager"
Sep 08 15:51:51.256000 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.255911    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a4f489-1972-46a1-93e2-7112add77232" containerName="manager"
Sep 08 15:51:51.256000 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.255981    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="08f486b3-92e0-4adc-995a-93ab4cd15e5d" containerName="manager"
Sep 08 15:51:51.256000 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.255989    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9a4f489-1972-46a1-93e2-7112add77232" containerName="manager"
Sep 08 15:51:51.260282 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.260263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:51:51.262312 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.262288    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9sb96\""
Sep 08 15:51:51.262444 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.262290    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 15:51:51.266807 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.266770    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"]
Sep 08 15:51:51.270047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.270021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:51.278377 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.278348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55b7b778-aef0-4833-862c-602182c4c5ac-config-file\") pod \"limitador-limitador-859c4d96d6-7zvzs\" (UID: \"55b7b778-aef0-4833-862c-602182c4c5ac\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:51:51.278560 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.278387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgqqg\" (UniqueName: \"kubernetes.io/projected/55b7b778-aef0-4833-862c-602182c4c5ac-kube-api-access-zgqqg\") pod \"limitador-limitador-859c4d96d6-7zvzs\" (UID: \"55b7b778-aef0-4833-862c-602182c4c5ac\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:51:51.354107 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.354065    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"]
Sep 08 15:51:51.368546 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.368508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:51.379841 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.379800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55b7b778-aef0-4833-862c-602182c4c5ac-config-file\") pod \"limitador-limitador-859c4d96d6-7zvzs\" (UID: \"55b7b778-aef0-4833-862c-602182c4c5ac\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:51:51.380016 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.379871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgqqg\" (UniqueName: \"kubernetes.io/projected/55b7b778-aef0-4833-862c-602182c4c5ac-kube-api-access-zgqqg\") pod \"limitador-limitador-859c4d96d6-7zvzs\" (UID: \"55b7b778-aef0-4833-862c-602182c4c5ac\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:51:51.380440 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.380421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55b7b778-aef0-4833-862c-602182c4c5ac-config-file\") pod \"limitador-limitador-859c4d96d6-7zvzs\" (UID: \"55b7b778-aef0-4833-862c-602182c4c5ac\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:51:51.388781 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.388750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgqqg\" (UniqueName: \"kubernetes.io/projected/55b7b778-aef0-4833-862c-602182c4c5ac-kube-api-access-zgqqg\") pod \"limitador-limitador-859c4d96d6-7zvzs\" (UID: \"55b7b778-aef0-4833-862c-602182c4c5ac\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:51:51.472042 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.472002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:51.571508 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.571424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:51:51.847227 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:51.847198    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"]
Sep 08 15:51:51.849686 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:51:51.849657    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b7b778_aef0_4833_862c_602182c4c5ac.slice/crio-910bb3ff4487f56771c52fba2c1d8523a232ec1937dae9594a71fff2f13646a0 WatchSource:0}: Error finding container 910bb3ff4487f56771c52fba2c1d8523a232ec1937dae9594a71fff2f13646a0: Status 404 returned error can't find the container with id 910bb3ff4487f56771c52fba2c1d8523a232ec1937dae9594a71fff2f13646a0
Sep 08 15:51:52.111134 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:52.111060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:52.201220 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:52.201188    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:52.458803 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:52.458762    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs" event={"ID":"55b7b778-aef0-4833-862c-602182c4c5ac","Type":"ContainerStarted","Data":"910bb3ff4487f56771c52fba2c1d8523a232ec1937dae9594a71fff2f13646a0"}
Sep 08 15:51:53.465732 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:53.465692    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs" event={"ID":"55b7b778-aef0-4833-862c-602182c4c5ac","Type":"ContainerStarted","Data":"a163642681852456e9dbd5c603416d092aebf490f4128f50ad921abe56165791"}
Sep 08 15:51:53.466193 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:53.465817    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:51:53.485465 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:51:53.485411    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs" podStartSLOduration=1.041696312 podStartE2EDuration="2.485394097s" totalImagesPullingTime="1.443697785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:51:53.483347798 +0000 UTC m=+441.605503413" watchObservedRunningTime="2026-09-08 15:51:53.485394097 +0000 UTC m=+441.607549746"
Sep 08 15:52:04.472501 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:04.472424    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:52:05.042353 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.042311    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"]
Sep 08 15:52:05.042555 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.042527    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs" podUID="55b7b778-aef0-4833-862c-602182c4c5ac" containerName="limitador" containerID="cri-o://a163642681852456e9dbd5c603416d092aebf490f4128f50ad921abe56165791" gracePeriod=30
Sep 08 15:52:05.531896 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.531863    2581 generic.go:356] "Generic (PLEG): container finished" podID="55b7b778-aef0-4833-862c-602182c4c5ac" containerID="a163642681852456e9dbd5c603416d092aebf490f4128f50ad921abe56165791" exitCode=0
Sep 08 15:52:05.532270 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.531939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs" event={"ID":"55b7b778-aef0-4833-862c-602182c4c5ac","Type":"ContainerDied","Data":"a163642681852456e9dbd5c603416d092aebf490f4128f50ad921abe56165791"}
Sep 08 15:52:05.585024 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.584998    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:52:05.701332 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.701292    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55b7b778-aef0-4833-862c-602182c4c5ac-config-file\") pod \"55b7b778-aef0-4833-862c-602182c4c5ac\" (UID: \"55b7b778-aef0-4833-862c-602182c4c5ac\") "
Sep 08 15:52:05.701516 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.701370    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgqqg\" (UniqueName: \"kubernetes.io/projected/55b7b778-aef0-4833-862c-602182c4c5ac-kube-api-access-zgqqg\") pod \"55b7b778-aef0-4833-862c-602182c4c5ac\" (UID: \"55b7b778-aef0-4833-862c-602182c4c5ac\") "
Sep 08 15:52:05.701746 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.701719    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55b7b778-aef0-4833-862c-602182c4c5ac-config-file" (OuterVolumeSpecName: "config-file") pod "55b7b778-aef0-4833-862c-602182c4c5ac" (UID: "55b7b778-aef0-4833-862c-602182c4c5ac"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:52:05.703495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.703474    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55b7b778-aef0-4833-862c-602182c4c5ac-kube-api-access-zgqqg" (OuterVolumeSpecName: "kube-api-access-zgqqg") pod "55b7b778-aef0-4833-862c-602182c4c5ac" (UID: "55b7b778-aef0-4833-862c-602182c4c5ac"). InnerVolumeSpecName "kube-api-access-zgqqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:52:05.802356 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.802303    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgqqg\" (UniqueName: \"kubernetes.io/projected/55b7b778-aef0-4833-862c-602182c4c5ac-kube-api-access-zgqqg\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:52:05.802356 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:05.802346    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55b7b778-aef0-4833-862c-602182c4c5ac-config-file\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:52:06.263324 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.263220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:06.354279 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.354240    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:06.538085 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.538000    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"
Sep 08 15:52:06.538519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.538001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-7zvzs" event={"ID":"55b7b778-aef0-4833-862c-602182c4c5ac","Type":"ContainerDied","Data":"910bb3ff4487f56771c52fba2c1d8523a232ec1937dae9594a71fff2f13646a0"}
Sep 08 15:52:06.538519 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.538136    2581 scope.go:117] "RemoveContainer" containerID="a163642681852456e9dbd5c603416d092aebf490f4128f50ad921abe56165791"
Sep 08 15:52:06.554240 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.554212    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"]
Sep 08 15:52:06.561004 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.560981    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-7zvzs"]
Sep 08 15:52:06.781481 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.781444    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"]
Sep 08 15:52:06.781888 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.781870    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55b7b778-aef0-4833-862c-602182c4c5ac" containerName="limitador"
Sep 08 15:52:06.781989 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.781890    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55b7b778-aef0-4833-862c-602182c4c5ac" containerName="limitador"
Sep 08 15:52:06.781989 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.781972    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="55b7b778-aef0-4833-862c-602182c4c5ac" containerName="limitador"
Sep 08 15:52:06.786319 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.786292    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"
Sep 08 15:52:06.788516 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.788448    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 15:52:06.788639 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.788599    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 15:52:06.788785 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.788767    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:52:06.789248 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.789234    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-dbzg7\""
Sep 08 15:52:06.796459 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.796436    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"]
Sep 08 15:52:06.818061 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.818030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:06.912288 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.912248    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjdns\" (UniqueName: \"kubernetes.io/projected/96dae3c4-faa0-4293-9341-df83833eb2cb-kube-api-access-tjdns\") pod \"postgres-69fb4594cf-pvqh9\" (UID: \"96dae3c4-faa0-4293-9341-df83833eb2cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"
Sep 08 15:52:06.912467 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:06.912307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96dae3c4-faa0-4293-9341-df83833eb2cb-data\") pod \"postgres-69fb4594cf-pvqh9\" (UID: \"96dae3c4-faa0-4293-9341-df83833eb2cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"
Sep 08 15:52:07.013336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:07.013297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96dae3c4-faa0-4293-9341-df83833eb2cb-data\") pod \"postgres-69fb4594cf-pvqh9\" (UID: \"96dae3c4-faa0-4293-9341-df83833eb2cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"
Sep 08 15:52:07.013512 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:07.013368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjdns\" (UniqueName: \"kubernetes.io/projected/96dae3c4-faa0-4293-9341-df83833eb2cb-kube-api-access-tjdns\") pod \"postgres-69fb4594cf-pvqh9\" (UID: \"96dae3c4-faa0-4293-9341-df83833eb2cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"
Sep 08 15:52:07.013707 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:07.013688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96dae3c4-faa0-4293-9341-df83833eb2cb-data\") pod \"postgres-69fb4594cf-pvqh9\" (UID: \"96dae3c4-faa0-4293-9341-df83833eb2cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"
Sep 08 15:52:07.022110 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:07.022080    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjdns\" (UniqueName: \"kubernetes.io/projected/96dae3c4-faa0-4293-9341-df83833eb2cb-kube-api-access-tjdns\") pod \"postgres-69fb4594cf-pvqh9\" (UID: \"96dae3c4-faa0-4293-9341-df83833eb2cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"
Sep 08 15:52:07.097163 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:07.097073    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"
Sep 08 15:52:07.371858 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:07.371830    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"]
Sep 08 15:52:07.373792 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:52:07.373770    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96dae3c4_faa0_4293_9341_df83833eb2cb.slice/crio-fb08d896fff92c4324538c9e089b82720c7b2b37349890086ccd7b67cd92cc9e WatchSource:0}: Error finding container fb08d896fff92c4324538c9e089b82720c7b2b37349890086ccd7b67cd92cc9e: Status 404 returned error can't find the container with id fb08d896fff92c4324538c9e089b82720c7b2b37349890086ccd7b67cd92cc9e
Sep 08 15:52:07.545912 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:07.545859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9" event={"ID":"96dae3c4-faa0-4293-9341-df83833eb2cb","Type":"ContainerStarted","Data":"fb08d896fff92c4324538c9e089b82720c7b2b37349890086ccd7b67cd92cc9e"}
Sep 08 15:52:08.368013 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:08.367961    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55b7b778-aef0-4833-862c-602182c4c5ac" path="/var/lib/kubelet/pods/55b7b778-aef0-4833-862c-602182c4c5ac/volumes"
Sep 08 15:52:12.579215 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:12.579176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9" event={"ID":"96dae3c4-faa0-4293-9341-df83833eb2cb","Type":"ContainerStarted","Data":"12a4b62a352ac3137313bc36ee787a5aa87fed26e0c4495c2fcd26a1f69e5483"}
Sep 08 15:52:12.579647 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:12.579293    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"
Sep 08 15:52:12.597716 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:12.597610    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9" podStartSLOduration=1.6238792850000001 podStartE2EDuration="6.597594058s" totalImagesPullingTime="4.973714773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:52:12.595702017 +0000 UTC m=+460.717857632" watchObservedRunningTime="2026-09-08 15:52:12.597594058 +0000 UTC m=+460.719749752"
Sep 08 15:52:18.613214 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:18.613183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pvqh9"
Sep 08 15:52:18.926767 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:18.926732    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:19.147793 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.147753    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-n2vb7"]
Sep 08 15:52:19.153121 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.153096    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-n2vb7"
Sep 08 15:52:19.155195 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.155171    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2znf2\""
Sep 08 15:52:19.158545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.158517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-n2vb7"]
Sep 08 15:52:19.160454 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.160423    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:19.216973 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.216887    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-n2vb7"]
Sep 08 15:52:19.217178 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:52:19.217156    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-x7dsf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-n2vb7" podUID="a7309e1a-cb0d-4e5f-ad78-072e7914286f"
Sep 08 15:52:19.219970 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.219940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7dsf\" (UniqueName: \"kubernetes.io/projected/a7309e1a-cb0d-4e5f-ad78-072e7914286f-kube-api-access-x7dsf\") pod \"authorino-5dc7ccb5f-n2vb7\" (UID: \"a7309e1a-cb0d-4e5f-ad78-072e7914286f\") " pod="kuadrant-system/authorino-5dc7ccb5f-n2vb7"
Sep 08 15:52:19.320334 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.320299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7dsf\" (UniqueName: \"kubernetes.io/projected/a7309e1a-cb0d-4e5f-ad78-072e7914286f-kube-api-access-x7dsf\") pod \"authorino-5dc7ccb5f-n2vb7\" (UID: \"a7309e1a-cb0d-4e5f-ad78-072e7914286f\") " pod="kuadrant-system/authorino-5dc7ccb5f-n2vb7"
Sep 08 15:52:19.328616 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.328576    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7dsf\" (UniqueName: \"kubernetes.io/projected/a7309e1a-cb0d-4e5f-ad78-072e7914286f-kube-api-access-x7dsf\") pod \"authorino-5dc7ccb5f-n2vb7\" (UID: \"a7309e1a-cb0d-4e5f-ad78-072e7914286f\") " pod="kuadrant-system/authorino-5dc7ccb5f-n2vb7"
Sep 08 15:52:19.615933 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.615849    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-n2vb7"
Sep 08 15:52:19.623428 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.623397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-n2vb7"
Sep 08 15:52:19.723247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.723204    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7dsf\" (UniqueName: \"kubernetes.io/projected/a7309e1a-cb0d-4e5f-ad78-072e7914286f-kube-api-access-x7dsf\") pod \"a7309e1a-cb0d-4e5f-ad78-072e7914286f\" (UID: \"a7309e1a-cb0d-4e5f-ad78-072e7914286f\") "
Sep 08 15:52:19.725331 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.725297    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7309e1a-cb0d-4e5f-ad78-072e7914286f-kube-api-access-x7dsf" (OuterVolumeSpecName: "kube-api-access-x7dsf") pod "a7309e1a-cb0d-4e5f-ad78-072e7914286f" (UID: "a7309e1a-cb0d-4e5f-ad78-072e7914286f"). InnerVolumeSpecName "kube-api-access-x7dsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:52:19.823934 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:19.823896    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7dsf\" (UniqueName: \"kubernetes.io/projected/a7309e1a-cb0d-4e5f-ad78-072e7914286f-kube-api-access-x7dsf\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:52:20.621026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:20.620949    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-n2vb7"
Sep 08 15:52:20.647396 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:20.647360    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-n2vb7"]
Sep 08 15:52:20.653604 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:20.653575    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-n2vb7"]
Sep 08 15:52:22.365198 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:22.365162    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7309e1a-cb0d-4e5f-ad78-072e7914286f" path="/var/lib/kubelet/pods/a7309e1a-cb0d-4e5f-ad78-072e7914286f/volumes"
Sep 08 15:52:25.958733 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:25.958700    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:25.992250 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:25.992206    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-846c95cc5b-92zl4"]
Sep 08 15:52:25.995498 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:25.995473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:25.999731 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:25.999702    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4tklt\""
Sep 08 15:52:25.999900 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:25.999702    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 15:52:25.999900 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:25.999744    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:52:25.999900 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:25.999710    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 15:52:26.014739 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.014709    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-846c95cc5b-92zl4"]
Sep 08 15:52:26.058105 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.058068    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:26.080328 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.080295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-webhook-cert\") pod \"maas-controller-846c95cc5b-92zl4\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") " pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:26.080512 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.080339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-metrics-certs\") pod \"maas-controller-846c95cc5b-92zl4\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") " pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:26.080512 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.080367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz4mf\" (UniqueName: \"kubernetes.io/projected/ab8a0525-18b1-42e9-87b7-a81d29d221ef-kube-api-access-sz4mf\") pod \"maas-controller-846c95cc5b-92zl4\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") " pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:26.158233 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.158196    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:26.181527 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.181490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz4mf\" (UniqueName: \"kubernetes.io/projected/ab8a0525-18b1-42e9-87b7-a81d29d221ef-kube-api-access-sz4mf\") pod \"maas-controller-846c95cc5b-92zl4\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") " pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:26.181711 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.181553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-webhook-cert\") pod \"maas-controller-846c95cc5b-92zl4\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") " pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:26.181711 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.181590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-metrics-certs\") pod \"maas-controller-846c95cc5b-92zl4\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") " pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:26.184202 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.184172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-metrics-certs\") pod \"maas-controller-846c95cc5b-92zl4\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") " pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:26.184202 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.184188    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-webhook-cert\") pod \"maas-controller-846c95cc5b-92zl4\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") " pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:26.195976 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.195943    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz4mf\" (UniqueName: \"kubernetes.io/projected/ab8a0525-18b1-42e9-87b7-a81d29d221ef-kube-api-access-sz4mf\") pod \"maas-controller-846c95cc5b-92zl4\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") " pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:26.306898 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.306777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:26.589026 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.586538    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-846c95cc5b-92zl4"]
Sep 08 15:52:26.652805 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:26.652762    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-846c95cc5b-92zl4" event={"ID":"ab8a0525-18b1-42e9-87b7-a81d29d221ef","Type":"ContainerStarted","Data":"cbd6a8d18019cd60b9cd3e59134957f7eb9717e9a90a166b0426743acdd346df"}
Sep 08 15:52:29.382588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:29.382556    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:29.559321 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:29.559231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:29.672899 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:29.672862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-846c95cc5b-92zl4" event={"ID":"ab8a0525-18b1-42e9-87b7-a81d29d221ef","Type":"ContainerStarted","Data":"f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9"}
Sep 08 15:52:29.673069 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:29.672959    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:29.696627 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:29.696572    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-846c95cc5b-92zl4" podStartSLOduration=2.072535106 podStartE2EDuration="4.696553723s" totalImagesPullingTime="2.624018617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:52:29.694254923 +0000 UTC m=+477.816410541" watchObservedRunningTime="2026-09-08 15:52:29.696553723 +0000 UTC m=+477.818709338"
Sep 08 15:52:40.681025 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:40.680990    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:41.151081 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.151029    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-846c95cc5b-92zl4"]
Sep 08 15:52:41.151352 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.151291    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-846c95cc5b-92zl4" podUID="ab8a0525-18b1-42e9-87b7-a81d29d221ef" containerName="manager" containerID="cri-o://f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9" gracePeriod=30
Sep 08 15:52:41.394321 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.394292    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:41.415768 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.415655    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz4mf\" (UniqueName: \"kubernetes.io/projected/ab8a0525-18b1-42e9-87b7-a81d29d221ef-kube-api-access-sz4mf\") pod \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") "
Sep 08 15:52:41.415768 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.415721    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-metrics-certs\") pod \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") "
Sep 08 15:52:41.416039 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.415787    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-webhook-cert\") pod \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\" (UID: \"ab8a0525-18b1-42e9-87b7-a81d29d221ef\") "
Sep 08 15:52:41.418327 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.418289    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8a0525-18b1-42e9-87b7-a81d29d221ef-kube-api-access-sz4mf" (OuterVolumeSpecName: "kube-api-access-sz4mf") pod "ab8a0525-18b1-42e9-87b7-a81d29d221ef" (UID: "ab8a0525-18b1-42e9-87b7-a81d29d221ef"). InnerVolumeSpecName "kube-api-access-sz4mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:52:41.418460 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.418323    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ab8a0525-18b1-42e9-87b7-a81d29d221ef" (UID: "ab8a0525-18b1-42e9-87b7-a81d29d221ef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:52:41.418505 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.418462    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ab8a0525-18b1-42e9-87b7-a81d29d221ef" (UID: "ab8a0525-18b1-42e9-87b7-a81d29d221ef"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:52:41.516433 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.516394    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz4mf\" (UniqueName: \"kubernetes.io/projected/ab8a0525-18b1-42e9-87b7-a81d29d221ef-kube-api-access-sz4mf\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:52:41.516433 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.516426    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:52:41.516433 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.516435    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab8a0525-18b1-42e9-87b7-a81d29d221ef-webhook-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:52:41.737251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.737155    2581 generic.go:356] "Generic (PLEG): container finished" podID="ab8a0525-18b1-42e9-87b7-a81d29d221ef" containerID="f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9" exitCode=0
Sep 08 15:52:41.737251 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.737202    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-846c95cc5b-92zl4"
Sep 08 15:52:41.737751 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.737196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-846c95cc5b-92zl4" event={"ID":"ab8a0525-18b1-42e9-87b7-a81d29d221ef","Type":"ContainerDied","Data":"f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9"}
Sep 08 15:52:41.737751 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.737321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-846c95cc5b-92zl4" event={"ID":"ab8a0525-18b1-42e9-87b7-a81d29d221ef","Type":"ContainerDied","Data":"cbd6a8d18019cd60b9cd3e59134957f7eb9717e9a90a166b0426743acdd346df"}
Sep 08 15:52:41.737751 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.737348    2581 scope.go:117] "RemoveContainer" containerID="f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9"
Sep 08 15:52:41.746721 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.746700    2581 scope.go:117] "RemoveContainer" containerID="f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9"
Sep 08 15:52:41.747061 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:52:41.747042    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9\": container with ID starting with f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9 not found: ID does not exist" containerID="f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9"
Sep 08 15:52:41.747119 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.747072    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9"} err="failed to get container status \"f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9\": rpc error: code = NotFound desc = could not find container \"f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9\": container with ID starting with f4e1e8fa0ccaac0fde2279e94367e8c787b20de8724efbade5a5c767a731cef9 not found: ID does not exist"
Sep 08 15:52:41.757219 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.757189    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-846c95cc5b-92zl4"]
Sep 08 15:52:41.760836 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:41.760796    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-846c95cc5b-92zl4"]
Sep 08 15:52:42.364969 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:52:42.364930    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab8a0525-18b1-42e9-87b7-a81d29d221ef" path="/var/lib/kubelet/pods/ab8a0525-18b1-42e9-87b7-a81d29d221ef/volumes"
Sep 08 15:53:00.007561 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:00.007525    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:00.107958 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:00.107923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:01.410297 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.410259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:01.474286 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.474244    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"]
Sep 08 15:53:01.474601 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.474588    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8a0525-18b1-42e9-87b7-a81d29d221ef" containerName="manager"
Sep 08 15:53:01.474645 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.474602    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8a0525-18b1-42e9-87b7-a81d29d221ef" containerName="manager"
Sep 08 15:53:01.474680 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.474661    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab8a0525-18b1-42e9-87b7-a81d29d221ef" containerName="manager"
Sep 08 15:53:01.477711 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.477688    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.479755 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.479733    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 15:53:01.479905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.479733    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 15:53:01.484103 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.484070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:01.489583 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.489554    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"]
Sep 08 15:53:01.583908 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.583875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-metrics-certs\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.583908 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.583912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhv44\" (UniqueName: \"kubernetes.io/projected/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-kube-api-access-jhv44\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.584160 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.583937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-maas-api-tls\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.584160 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.584050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-openshift-service-ca\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.648366 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.648321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:01.684816 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.684719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-metrics-certs\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.684816 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.684757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhv44\" (UniqueName: \"kubernetes.io/projected/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-kube-api-access-jhv44\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.684816 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.684786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-maas-api-tls\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.685162 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.684841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-openshift-service-ca\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.685525 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.685495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-openshift-service-ca\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.687250 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.687218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-maas-api-tls\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.687371 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.687350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-metrics-certs\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.694078 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.694050    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhv44\" (UniqueName: \"kubernetes.io/projected/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-kube-api-access-jhv44\") pod \"maas-api-5ff8b9db6-dhknw\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.741395 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.741364    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:01.789662 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.789619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:01.948940 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:01.948850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:02.051888 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:02.051810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:02.082220 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:02.082190    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"]
Sep 08 15:53:02.084927 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:53:02.084894    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6c027c_9e63_4c5c_bbab_2ef8fd84f466.slice/crio-ede9803353c9f7f53f8baf6795da6fcc5d81c27917cc591b7e3a4a4d41c4dea4 WatchSource:0}: Error finding container ede9803353c9f7f53f8baf6795da6fcc5d81c27917cc591b7e3a4a4d41c4dea4: Status 404 returned error can't find the container with id ede9803353c9f7f53f8baf6795da6fcc5d81c27917cc591b7e3a4a4d41c4dea4
Sep 08 15:53:02.847178 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:02.847138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw" event={"ID":"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466","Type":"ContainerStarted","Data":"ede9803353c9f7f53f8baf6795da6fcc5d81c27917cc591b7e3a4a4d41c4dea4"}
Sep 08 15:53:03.473894 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:03.473842    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:03.573858 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:03.573808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:03.853607 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:03.853559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw" event={"ID":"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466","Type":"ContainerStarted","Data":"1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84"}
Sep 08 15:53:03.854046 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:03.853624    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:03.871100 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:03.871045    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw" podStartSLOduration=1.236894428 podStartE2EDuration="2.871027578s" totalImagesPullingTime="1.63413315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:53:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:53:03.869912298 +0000 UTC m=+511.992067914" watchObservedRunningTime="2026-09-08 15:53:03.871027578 +0000 UTC m=+511.993183193"
Sep 08 15:53:09.864303 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:09.864271    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 15:53:10.847915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:10.847872    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:11.019039 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:11.019009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:14.185253 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:14.185214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:14.326688 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:14.326645    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:20.772231 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:20.772193    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:20.834102 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:20.834063    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:21.080056 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.079958    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"]
Sep 08 15:53:21.083683 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.083659    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.085881 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.085856    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 15:53:21.086027 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.085902    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-668bh\""
Sep 08 15:53:21.086027 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.085985    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 15:53:21.086489 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.086467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 08 15:53:21.093623 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.093590    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"]
Sep 08 15:53:21.117631 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.117599    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:21.155862 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.155795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.156019 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.155868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.156019 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.155968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l87n4\" (UniqueName: \"kubernetes.io/projected/f706cda6-316f-448b-9f3f-e8bea71c55ff-kube-api-access-l87n4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.156019 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.155999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.156019 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.156017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f706cda6-316f-448b-9f3f-e8bea71c55ff-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.156157 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.156078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.257198 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.257165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.257198 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.257209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.257424 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.257332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.257471 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.257448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l87n4\" (UniqueName: \"kubernetes.io/projected/f706cda6-316f-448b-9f3f-e8bea71c55ff-kube-api-access-l87n4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.257518 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.257488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.257570 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.257514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f706cda6-316f-448b-9f3f-e8bea71c55ff-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.257631 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.257591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.257710 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.257689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.257794 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.257772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.259479 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.259452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f706cda6-316f-448b-9f3f-e8bea71c55ff-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.259789 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.259772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f706cda6-316f-448b-9f3f-e8bea71c55ff-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.264895 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.264877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l87n4\" (UniqueName: \"kubernetes.io/projected/f706cda6-316f-448b-9f3f-e8bea71c55ff-kube-api-access-l87n4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f\" (UID: \"f706cda6-316f-448b-9f3f-e8bea71c55ff\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.395139 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.395039    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:21.671588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.671562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"]
Sep 08 15:53:21.673562 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:53:21.673537    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf706cda6_316f_448b_9f3f_e8bea71c55ff.slice/crio-374690ba396cbd4c2959e39934217496bad60bccf42c7f3823c76263869c8b5c WatchSource:0}: Error finding container 374690ba396cbd4c2959e39934217496bad60bccf42c7f3823c76263869c8b5c: Status 404 returned error can't find the container with id 374690ba396cbd4c2959e39934217496bad60bccf42c7f3823c76263869c8b5c
Sep 08 15:53:21.954417 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:21.954329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f" event={"ID":"f706cda6-316f-448b-9f3f-e8bea71c55ff","Type":"ContainerStarted","Data":"374690ba396cbd4c2959e39934217496bad60bccf42c7f3823c76263869c8b5c"}
Sep 08 15:53:22.961664 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:22.961628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f" event={"ID":"f706cda6-316f-448b-9f3f-e8bea71c55ff","Type":"ContainerStarted","Data":"9931efd03c878b4ee7c17dbcd5d05bf2013fc0633ea3a1cd3b7e20388a7d6fef"}
Sep 08 15:53:22.979635 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:22.979574    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f" podStartSLOduration=0.819287638 podStartE2EDuration="1.979555775s" totalImagesPullingTime="1.160268137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:53:22.977333953 +0000 UTC m=+531.099489574" watchObservedRunningTime="2026-09-08 15:53:22.979555775 +0000 UTC m=+531.101711420"
Sep 08 15:53:24.600414 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:24.600338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:31.396130 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:31.396084    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:31.396712 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:31.396168    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:31.409020 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:31.408988    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:32.018964 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:32.018932    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f"
Sep 08 15:53:35.684121 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:35.684088    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:48.165853 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.165799    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"]
Sep 08 15:53:48.172018 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.171988    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.174147 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.174117    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 08 15:53:48.181639 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.181606    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"]
Sep 08 15:53:48.192479 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.192443    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:48.195864 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.195817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.195864 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.195865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.196094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.195900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.196094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.195954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2ab52b-821a-425d-a676-ba82a6a08166-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.196094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.195990    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp6ln\" (UniqueName: \"kubernetes.io/projected/3a2ab52b-821a-425d-a676-ba82a6a08166-kube-api-access-dp6ln\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.196094 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.196012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.297229 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.297189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2ab52b-821a-425d-a676-ba82a6a08166-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.297444 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.297234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp6ln\" (UniqueName: \"kubernetes.io/projected/3a2ab52b-821a-425d-a676-ba82a6a08166-kube-api-access-dp6ln\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.297444 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.297266    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.297444 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.297339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.297444 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.297362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.297444 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.297406    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.297779 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.297749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.297945 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.297788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.298010 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.297855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.299725 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.299700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2ab52b-821a-425d-a676-ba82a6a08166-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.299952 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.299936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2ab52b-821a-425d-a676-ba82a6a08166-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.304850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.304797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp6ln\" (UniqueName: \"kubernetes.io/projected/3a2ab52b-821a-425d-a676-ba82a6a08166-kube-api-access-dp6ln\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pzk7\" (UID: \"3a2ab52b-821a-425d-a676-ba82a6a08166\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.486130 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.486033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:48.761429 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:48.761399    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"]
Sep 08 15:53:48.763003 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:53:48.762978    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2ab52b_821a_425d_a676_ba82a6a08166.slice/crio-a2afc55b1c7ba9355565471164cee9b4adad374546013abee4ea656690951bfd WatchSource:0}: Error finding container a2afc55b1c7ba9355565471164cee9b4adad374546013abee4ea656690951bfd: Status 404 returned error can't find the container with id a2afc55b1c7ba9355565471164cee9b4adad374546013abee4ea656690951bfd
Sep 08 15:53:49.098195 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:49.098158    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7" event={"ID":"3a2ab52b-821a-425d-a676-ba82a6a08166","Type":"ContainerStarted","Data":"ab7604de7e84d68759e9da4675e0392eda591d6c2187af5ab3393f0f93f71deb"}
Sep 08 15:53:49.098411 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:49.098228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7" event={"ID":"3a2ab52b-821a-425d-a676-ba82a6a08166","Type":"ContainerStarted","Data":"a2afc55b1c7ba9355565471164cee9b4adad374546013abee4ea656690951bfd"}
Sep 08 15:53:49.118558 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:49.118495    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7" podStartSLOduration=0.906325415 podStartE2EDuration="1.118474816s" totalImagesPullingTime="212.149401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:53:49.114625006 +0000 UTC m=+557.236780621" watchObservedRunningTime="2026-09-08 15:53:49.118474816 +0000 UTC m=+557.240630431"
Sep 08 15:53:58.487109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:58.487062    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:58.487526 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:58.487137    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:58.499870 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:58.499840    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:53:59.166471 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:53:59.166438    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pzk7"
Sep 08 15:54:00.298896 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:00.298862    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:07.572481 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:07.572442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:18.895316 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:18.895280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:23.742081 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:23.742047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:43.903036 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:43.902998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:44.596300 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.596262    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"]
Sep 08 15:54:44.599912 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.599892    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.602457 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.602430    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:54:44.602601 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.602563    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-twlpl\""
Sep 08 15:54:44.603118 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.603098    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:54:44.610046 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.610021    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"]
Sep 08 15:54:44.667039 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.667005    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"]
Sep 08 15:54:44.670543 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.670514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:44.682366 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.682329    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"]
Sep 08 15:54:44.697871 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.697832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.697871 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.697879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:44.698180 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.697933    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-994ll\" (UniqueName: \"kubernetes.io/projected/63d92fa2-15a1-4a14-8a8d-ec99f5528745-kube-api-access-994ll\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:44.698180 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.697964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.698180 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.697987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:44.698180 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.698104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzl4n\" (UniqueName: \"kubernetes.io/projected/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-kube-api-access-fzl4n\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.765928 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.765892    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"]
Sep 08 15:54:44.769464 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.769445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:44.778615 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.778586    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"]
Sep 08 15:54:44.798923 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.798892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-994ll\" (UniqueName: \"kubernetes.io/projected/63d92fa2-15a1-4a14-8a8d-ec99f5528745-kube-api-access-994ll\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:44.799106 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.798939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.799106 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.798967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:44.799106 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.799020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzl4n\" (UniqueName: \"kubernetes.io/projected/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-kube-api-access-fzl4n\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.799106 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.799062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:44.799106 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.799099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:44.799353 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.799134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4vxk\" (UniqueName: \"kubernetes.io/projected/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-kube-api-access-n4vxk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:44.799353 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.799261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.799353 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.799301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:44.799472 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.799422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.799472 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.799422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:44.799580 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.799559    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.799624 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.799608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:44.807936 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.807904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzl4n\" (UniqueName: \"kubernetes.io/projected/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-kube-api-access-fzl4n\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.808140 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.808125    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-994ll\" (UniqueName: \"kubernetes.io/projected/63d92fa2-15a1-4a14-8a8d-ec99f5528745-kube-api-access-994ll\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:44.860302 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.860210    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"]
Sep 08 15:54:44.864072 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.864049    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:44.872518 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.872494    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"]
Sep 08 15:54:44.899970 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.899933    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:44.900141 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.899979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:44.900141 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.900002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:44.900141 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.900062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4vxk\" (UniqueName: \"kubernetes.io/projected/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-kube-api-access-n4vxk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:44.900141 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.900110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:44.900141 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.900134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnvf4\" (UniqueName: \"kubernetes.io/projected/e97913aa-2b1f-441e-beca-29f61f122ebf-kube-api-access-wnvf4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:44.900410 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.900388    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:44.900447 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.900416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:44.908426 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.908392    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4vxk\" (UniqueName: \"kubernetes.io/projected/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-kube-api-access-n4vxk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:44.910181 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.910160    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:44.980340 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:44.980309    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:45.000891 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.000848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnvf4\" (UniqueName: \"kubernetes.io/projected/e97913aa-2b1f-441e-beca-29f61f122ebf-kube-api-access-wnvf4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:45.001052 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.000975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:45.001132 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.001048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:45.001407 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.001383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:45.001493 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.001400    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:45.009695 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.009662    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnvf4\" (UniqueName: \"kubernetes.io/projected/e97913aa-2b1f-441e-beca-29f61f122ebf-kube-api-access-wnvf4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:45.079749 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.079706    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:45.175458 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.175411    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:45.182834 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.182781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"]
Sep 08 15:54:45.186229 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:54:45.186198    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a844274_c0dd_43a4_b2c0_86cb2701ddfb.slice/crio-c6c764acd8866b30cad162425313e992adb7c2841cffedd1e9b450796f54e892 WatchSource:0}: Error finding container c6c764acd8866b30cad162425313e992adb7c2841cffedd1e9b450796f54e892: Status 404 returned error can't find the container with id c6c764acd8866b30cad162425313e992adb7c2841cffedd1e9b450796f54e892
Sep 08 15:54:45.261801 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.261775    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"]
Sep 08 15:54:45.264074 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:54:45.264045    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d92fa2_15a1_4a14_8a8d_ec99f5528745.slice/crio-ce305e2797e71a2e503159c585bc47d9709b5c662690caac5d0d31ea34e4a421 WatchSource:0}: Error finding container ce305e2797e71a2e503159c585bc47d9709b5c662690caac5d0d31ea34e4a421: Status 404 returned error can't find the container with id ce305e2797e71a2e503159c585bc47d9709b5c662690caac5d0d31ea34e4a421
Sep 08 15:54:45.354659 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.354630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"]
Sep 08 15:54:45.369549 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:54:45.369515    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc751b1_5c19_4c14_ba5d_d18d3a0b706b.slice/crio-d0d950034a1cac7783f66e8b1e81f75c5018e6c10daaadf4cea9baab76532591 WatchSource:0}: Error finding container d0d950034a1cac7783f66e8b1e81f75c5018e6c10daaadf4cea9baab76532591: Status 404 returned error can't find the container with id d0d950034a1cac7783f66e8b1e81f75c5018e6c10daaadf4cea9baab76532591
Sep 08 15:54:45.397064 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.397026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht" event={"ID":"63d92fa2-15a1-4a14-8a8d-ec99f5528745","Type":"ContainerStarted","Data":"4fbe410ae69530b6d7ee520ecb00402fcc6a8f042cbd501484e7cac6729d375d"}
Sep 08 15:54:45.397221 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.397084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht" event={"ID":"63d92fa2-15a1-4a14-8a8d-ec99f5528745","Type":"ContainerStarted","Data":"ce305e2797e71a2e503159c585bc47d9709b5c662690caac5d0d31ea34e4a421"}
Sep 08 15:54:45.398562 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.398528    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj" event={"ID":"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b","Type":"ContainerStarted","Data":"d0d950034a1cac7783f66e8b1e81f75c5018e6c10daaadf4cea9baab76532591"}
Sep 08 15:54:45.400492 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.400415    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a844274-c0dd-43a4-b2c0-86cb2701ddfb" containerID="1c29814ec97f0b1c5ab2a08b8e66d90c4d8f68942aaea32d8f1c65b99d6a2b8f" exitCode=0
Sep 08 15:54:45.400642 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.400510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn" event={"ID":"4a844274-c0dd-43a4-b2c0-86cb2701ddfb","Type":"ContainerDied","Data":"1c29814ec97f0b1c5ab2a08b8e66d90c4d8f68942aaea32d8f1c65b99d6a2b8f"}
Sep 08 15:54:45.400642 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.400554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn" event={"ID":"4a844274-c0dd-43a4-b2c0-86cb2701ddfb","Type":"ContainerStarted","Data":"c6c764acd8866b30cad162425313e992adb7c2841cffedd1e9b450796f54e892"}
Sep 08 15:54:45.456693 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:45.456667    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"]
Sep 08 15:54:45.490114 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:54:45.490071    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97913aa_2b1f_441e_beca_29f61f122ebf.slice/crio-72fb51bcf4204408c39a3cc3b879dbcd4ed4f342ea482ac492f6e3515b6779eb WatchSource:0}: Error finding container 72fb51bcf4204408c39a3cc3b879dbcd4ed4f342ea482ac492f6e3515b6779eb: Status 404 returned error can't find the container with id 72fb51bcf4204408c39a3cc3b879dbcd4ed4f342ea482ac492f6e3515b6779eb
Sep 08 15:54:46.408050 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:46.408013    2581 generic.go:356] "Generic (PLEG): container finished" podID="3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" containerID="e2a5d2ea387b77a974ce4c8e7075505679abc12d260e51070ae8d30e13aa02b3" exitCode=0
Sep 08 15:54:46.408509 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:46.408099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj" event={"ID":"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b","Type":"ContainerDied","Data":"e2a5d2ea387b77a974ce4c8e7075505679abc12d260e51070ae8d30e13aa02b3"}
Sep 08 15:54:46.410146 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:46.410119    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a844274-c0dd-43a4-b2c0-86cb2701ddfb" containerID="2df1ab7abd419f338cdc29d57ad8b7e25d10530e6aaf59edeaf717c0cd36fc48" exitCode=0
Sep 08 15:54:46.410303 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:46.410169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn" event={"ID":"4a844274-c0dd-43a4-b2c0-86cb2701ddfb","Type":"ContainerDied","Data":"2df1ab7abd419f338cdc29d57ad8b7e25d10530e6aaf59edeaf717c0cd36fc48"}
Sep 08 15:54:46.412002 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:46.411976    2581 generic.go:356] "Generic (PLEG): container finished" podID="63d92fa2-15a1-4a14-8a8d-ec99f5528745" containerID="4fbe410ae69530b6d7ee520ecb00402fcc6a8f042cbd501484e7cac6729d375d" exitCode=0
Sep 08 15:54:46.412137 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:46.412106    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht" event={"ID":"63d92fa2-15a1-4a14-8a8d-ec99f5528745","Type":"ContainerDied","Data":"4fbe410ae69530b6d7ee520ecb00402fcc6a8f042cbd501484e7cac6729d375d"}
Sep 08 15:54:46.414002 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:46.413976    2581 generic.go:356] "Generic (PLEG): container finished" podID="e97913aa-2b1f-441e-beca-29f61f122ebf" containerID="7f52350f5862a8d829e14fd57a7b44cfbedfdb570520ff0bed8f8f824dcfc87e" exitCode=0
Sep 08 15:54:46.414119 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:46.414021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs" event={"ID":"e97913aa-2b1f-441e-beca-29f61f122ebf","Type":"ContainerDied","Data":"7f52350f5862a8d829e14fd57a7b44cfbedfdb570520ff0bed8f8f824dcfc87e"}
Sep 08 15:54:46.414119 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:46.414053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs" event={"ID":"e97913aa-2b1f-441e-beca-29f61f122ebf","Type":"ContainerStarted","Data":"72fb51bcf4204408c39a3cc3b879dbcd4ed4f342ea482ac492f6e3515b6779eb"}
Sep 08 15:54:47.421547 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:47.421505    2581 generic.go:356] "Generic (PLEG): container finished" podID="3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" containerID="9665fe93a7783997f4bef912c991d1519913a76156936b8a2ff00e7e39dbb850" exitCode=0
Sep 08 15:54:47.422031 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:47.421596    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj" event={"ID":"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b","Type":"ContainerDied","Data":"9665fe93a7783997f4bef912c991d1519913a76156936b8a2ff00e7e39dbb850"}
Sep 08 15:54:47.424373 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:47.424313    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a844274-c0dd-43a4-b2c0-86cb2701ddfb" containerID="6526bd0529e6b6b8ca12810542fd364b87fc72d9bbe68ff93512d903c8930dfd" exitCode=0
Sep 08 15:54:47.424496 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:47.424395    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn" event={"ID":"4a844274-c0dd-43a4-b2c0-86cb2701ddfb","Type":"ContainerDied","Data":"6526bd0529e6b6b8ca12810542fd364b87fc72d9bbe68ff93512d903c8930dfd"}
Sep 08 15:54:47.426452 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:47.426424    2581 generic.go:356] "Generic (PLEG): container finished" podID="63d92fa2-15a1-4a14-8a8d-ec99f5528745" containerID="5e6e27ca2ff6d68a2272d6932e26ecebfc081a5f3222f8b47c35fa3fc799a066" exitCode=0
Sep 08 15:54:47.426582 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:47.426510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht" event={"ID":"63d92fa2-15a1-4a14-8a8d-ec99f5528745","Type":"ContainerDied","Data":"5e6e27ca2ff6d68a2272d6932e26ecebfc081a5f3222f8b47c35fa3fc799a066"}
Sep 08 15:54:47.428748 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:47.428725    2581 generic.go:356] "Generic (PLEG): container finished" podID="e97913aa-2b1f-441e-beca-29f61f122ebf" containerID="a3cef4f5f12a29048811a5b9d475892ff29a0ceac9e8acf93632b80fd6ca5416" exitCode=0
Sep 08 15:54:47.428853 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:47.428770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs" event={"ID":"e97913aa-2b1f-441e-beca-29f61f122ebf","Type":"ContainerDied","Data":"a3cef4f5f12a29048811a5b9d475892ff29a0ceac9e8acf93632b80fd6ca5416"}
Sep 08 15:54:47.786689 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:47.786579    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:47.886995 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:47.886960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:48.437182 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.437138    2581 generic.go:356] "Generic (PLEG): container finished" podID="63d92fa2-15a1-4a14-8a8d-ec99f5528745" containerID="546a914f5cfb68db97102390b5c3538eaa453df546bce24bf89fd5fe78e0bbc8" exitCode=0
Sep 08 15:54:48.437655 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.437259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht" event={"ID":"63d92fa2-15a1-4a14-8a8d-ec99f5528745","Type":"ContainerDied","Data":"546a914f5cfb68db97102390b5c3538eaa453df546bce24bf89fd5fe78e0bbc8"}
Sep 08 15:54:48.439564 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.439540    2581 generic.go:356] "Generic (PLEG): container finished" podID="e97913aa-2b1f-441e-beca-29f61f122ebf" containerID="b21098be738bc89f98b59b5bc38dc32bb6b1a982850a31774300df665d592ff0" exitCode=0
Sep 08 15:54:48.439700 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.439568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs" event={"ID":"e97913aa-2b1f-441e-beca-29f61f122ebf","Type":"ContainerDied","Data":"b21098be738bc89f98b59b5bc38dc32bb6b1a982850a31774300df665d592ff0"}
Sep 08 15:54:48.441851 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.441815    2581 generic.go:356] "Generic (PLEG): container finished" podID="3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" containerID="a2deb51765ce5739a5c5284ca9c0f510a63d9287a15226a08efb32b68317f141" exitCode=0
Sep 08 15:54:48.441851 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.441846    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj" event={"ID":"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b","Type":"ContainerDied","Data":"a2deb51765ce5739a5c5284ca9c0f510a63d9287a15226a08efb32b68317f141"}
Sep 08 15:54:48.577024 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.576998    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:48.636194 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.636155    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-util\") pod \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") "
Sep 08 15:54:48.636194 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.636202    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-bundle\") pod \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") "
Sep 08 15:54:48.636409 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.636231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzl4n\" (UniqueName: \"kubernetes.io/projected/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-kube-api-access-fzl4n\") pod \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\" (UID: \"4a844274-c0dd-43a4-b2c0-86cb2701ddfb\") "
Sep 08 15:54:48.636706 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.636667    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-bundle" (OuterVolumeSpecName: "bundle") pod "4a844274-c0dd-43a4-b2c0-86cb2701ddfb" (UID: "4a844274-c0dd-43a4-b2c0-86cb2701ddfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:54:48.638438 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.638410    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-kube-api-access-fzl4n" (OuterVolumeSpecName: "kube-api-access-fzl4n") pod "4a844274-c0dd-43a4-b2c0-86cb2701ddfb" (UID: "4a844274-c0dd-43a4-b2c0-86cb2701ddfb"). InnerVolumeSpecName "kube-api-access-fzl4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:54:48.641702 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.641666    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-util" (OuterVolumeSpecName: "util") pod "4a844274-c0dd-43a4-b2c0-86cb2701ddfb" (UID: "4a844274-c0dd-43a4-b2c0-86cb2701ddfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:54:48.737225 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.737137    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:48.737225 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.737167    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:48.737225 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:48.737177    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzl4n\" (UniqueName: \"kubernetes.io/projected/4a844274-c0dd-43a4-b2c0-86cb2701ddfb-kube-api-access-fzl4n\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:49.450103 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.450062    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn"
Sep 08 15:54:49.450103 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.450089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mv4mn" event={"ID":"4a844274-c0dd-43a4-b2c0-86cb2701ddfb","Type":"ContainerDied","Data":"c6c764acd8866b30cad162425313e992adb7c2841cffedd1e9b450796f54e892"}
Sep 08 15:54:49.450570 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.450143    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6c764acd8866b30cad162425313e992adb7c2841cffedd1e9b450796f54e892"
Sep 08 15:54:49.599311 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.599282    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:54:49.645885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.645842    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-util\") pod \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") "
Sep 08 15:54:49.646055 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.645927    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-bundle\") pod \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") "
Sep 08 15:54:49.646055 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.645983    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4vxk\" (UniqueName: \"kubernetes.io/projected/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-kube-api-access-n4vxk\") pod \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\" (UID: \"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b\") "
Sep 08 15:54:49.646462 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.646423    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-bundle" (OuterVolumeSpecName: "bundle") pod "3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" (UID: "3dc751b1-5c19-4c14-ba5d-d18d3a0b706b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:54:49.648288 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.648261    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-kube-api-access-n4vxk" (OuterVolumeSpecName: "kube-api-access-n4vxk") pod "3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" (UID: "3dc751b1-5c19-4c14-ba5d-d18d3a0b706b"). InnerVolumeSpecName "kube-api-access-n4vxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:54:49.651756 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.651725    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-util" (OuterVolumeSpecName: "util") pod "3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" (UID: "3dc751b1-5c19-4c14-ba5d-d18d3a0b706b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:54:49.661533 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.661503    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:49.665522 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.665497    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:49.746704 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.746602    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-util\") pod \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") "
Sep 08 15:54:49.746704 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.746657    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnvf4\" (UniqueName: \"kubernetes.io/projected/e97913aa-2b1f-441e-beca-29f61f122ebf-kube-api-access-wnvf4\") pod \"e97913aa-2b1f-441e-beca-29f61f122ebf\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") "
Sep 08 15:54:49.746704 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.746701    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-util\") pod \"e97913aa-2b1f-441e-beca-29f61f122ebf\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") "
Sep 08 15:54:49.747016 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.746723    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-bundle\") pod \"e97913aa-2b1f-441e-beca-29f61f122ebf\" (UID: \"e97913aa-2b1f-441e-beca-29f61f122ebf\") "
Sep 08 15:54:49.747016 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.746758    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-994ll\" (UniqueName: \"kubernetes.io/projected/63d92fa2-15a1-4a14-8a8d-ec99f5528745-kube-api-access-994ll\") pod \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") "
Sep 08 15:54:49.747016 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.746782    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-bundle\") pod \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\" (UID: \"63d92fa2-15a1-4a14-8a8d-ec99f5528745\") "
Sep 08 15:54:49.747193 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.747096    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:49.747193 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.747118    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:49.747193 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.747136    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4vxk\" (UniqueName: \"kubernetes.io/projected/3dc751b1-5c19-4c14-ba5d-d18d3a0b706b-kube-api-access-n4vxk\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:49.747495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.747465    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-bundle" (OuterVolumeSpecName: "bundle") pod "63d92fa2-15a1-4a14-8a8d-ec99f5528745" (UID: "63d92fa2-15a1-4a14-8a8d-ec99f5528745"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:54:49.747794 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.747764    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-bundle" (OuterVolumeSpecName: "bundle") pod "e97913aa-2b1f-441e-beca-29f61f122ebf" (UID: "e97913aa-2b1f-441e-beca-29f61f122ebf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:54:49.749071 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.749038    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d92fa2-15a1-4a14-8a8d-ec99f5528745-kube-api-access-994ll" (OuterVolumeSpecName: "kube-api-access-994ll") pod "63d92fa2-15a1-4a14-8a8d-ec99f5528745" (UID: "63d92fa2-15a1-4a14-8a8d-ec99f5528745"). InnerVolumeSpecName "kube-api-access-994ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:54:49.749302 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.749274    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e97913aa-2b1f-441e-beca-29f61f122ebf-kube-api-access-wnvf4" (OuterVolumeSpecName: "kube-api-access-wnvf4") pod "e97913aa-2b1f-441e-beca-29f61f122ebf" (UID: "e97913aa-2b1f-441e-beca-29f61f122ebf"). InnerVolumeSpecName "kube-api-access-wnvf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:54:49.752473 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.752441    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-util" (OuterVolumeSpecName: "util") pod "63d92fa2-15a1-4a14-8a8d-ec99f5528745" (UID: "63d92fa2-15a1-4a14-8a8d-ec99f5528745"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:54:49.752473 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.752454    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-util" (OuterVolumeSpecName: "util") pod "e97913aa-2b1f-441e-beca-29f61f122ebf" (UID: "e97913aa-2b1f-441e-beca-29f61f122ebf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:54:49.848076 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.848027    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:49.848076 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.848063    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e97913aa-2b1f-441e-beca-29f61f122ebf-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:49.848076 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.848073    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-994ll\" (UniqueName: \"kubernetes.io/projected/63d92fa2-15a1-4a14-8a8d-ec99f5528745-kube-api-access-994ll\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:49.848076 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.848084    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-bundle\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:49.848345 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.848093    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d92fa2-15a1-4a14-8a8d-ec99f5528745-util\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:49.848345 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:49.848100    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnvf4\" (UniqueName: \"kubernetes.io/projected/e97913aa-2b1f-441e-beca-29f61f122ebf-kube-api-access-wnvf4\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:54:50.457437 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:50.457405    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht"
Sep 08 15:54:50.457437 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:50.457425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnckht" event={"ID":"63d92fa2-15a1-4a14-8a8d-ec99f5528745","Type":"ContainerDied","Data":"ce305e2797e71a2e503159c585bc47d9709b5c662690caac5d0d31ea34e4a421"}
Sep 08 15:54:50.457941 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:50.457469    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce305e2797e71a2e503159c585bc47d9709b5c662690caac5d0d31ea34e4a421"
Sep 08 15:54:50.459623 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:50.459594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs" event={"ID":"e97913aa-2b1f-441e-beca-29f61f122ebf","Type":"ContainerDied","Data":"72fb51bcf4204408c39a3cc3b879dbcd4ed4f342ea482ac492f6e3515b6779eb"}
Sep 08 15:54:50.459761 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:50.459643    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72fb51bcf4204408c39a3cc3b879dbcd4ed4f342ea482ac492f6e3515b6779eb"
Sep 08 15:54:50.459761 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:50.459666    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a99bxs"
Sep 08 15:54:50.461924 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:50.461902    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj" event={"ID":"3dc751b1-5c19-4c14-ba5d-d18d3a0b706b","Type":"ContainerDied","Data":"d0d950034a1cac7783f66e8b1e81f75c5018e6c10daaadf4cea9baab76532591"}
Sep 08 15:54:50.462024 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:50.461935    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0d950034a1cac7783f66e8b1e81f75c5018e6c10daaadf4cea9baab76532591"
Sep 08 15:54:50.462074 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:54:50.462021    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzmdj"
Sep 08 15:55:09.819416 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:09.819297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:10.683262 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683210    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg"]
Sep 08 15:55:10.683671 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683650    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e97913aa-2b1f-441e-beca-29f61f122ebf" containerName="util"
Sep 08 15:55:10.683671 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683672    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e97913aa-2b1f-441e-beca-29f61f122ebf" containerName="util"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683683    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a844274-c0dd-43a4-b2c0-86cb2701ddfb" containerName="pull"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683691    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a844274-c0dd-43a4-b2c0-86cb2701ddfb" containerName="pull"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683708    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e97913aa-2b1f-441e-beca-29f61f122ebf" containerName="extract"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683716    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e97913aa-2b1f-441e-beca-29f61f122ebf" containerName="extract"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683732    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e97913aa-2b1f-441e-beca-29f61f122ebf" containerName="pull"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683739    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e97913aa-2b1f-441e-beca-29f61f122ebf" containerName="pull"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683749    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" containerName="extract"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683758    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" containerName="extract"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683769    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d92fa2-15a1-4a14-8a8d-ec99f5528745" containerName="extract"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683776    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d92fa2-15a1-4a14-8a8d-ec99f5528745" containerName="extract"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683788    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d92fa2-15a1-4a14-8a8d-ec99f5528745" containerName="util"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683796    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d92fa2-15a1-4a14-8a8d-ec99f5528745" containerName="util"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683808    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a844274-c0dd-43a4-b2c0-86cb2701ddfb" containerName="util"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683833    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a844274-c0dd-43a4-b2c0-86cb2701ddfb" containerName="util"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683845    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" containerName="util"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683853    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" containerName="util"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683864    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d92fa2-15a1-4a14-8a8d-ec99f5528745" containerName="pull"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683872    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d92fa2-15a1-4a14-8a8d-ec99f5528745" containerName="pull"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683886    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a844274-c0dd-43a4-b2c0-86cb2701ddfb" containerName="extract"
Sep 08 15:55:10.683885 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683894    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a844274-c0dd-43a4-b2c0-86cb2701ddfb" containerName="extract"
Sep 08 15:55:10.684783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683904    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" containerName="pull"
Sep 08 15:55:10.684783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.683911    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" containerName="pull"
Sep 08 15:55:10.684783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.684022    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc751b1-5c19-4c14-ba5d-d18d3a0b706b" containerName="extract"
Sep 08 15:55:10.684783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.684033    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a844274-c0dd-43a4-b2c0-86cb2701ddfb" containerName="extract"
Sep 08 15:55:10.684783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.684043    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e97913aa-2b1f-441e-beca-29f61f122ebf" containerName="extract"
Sep 08 15:55:10.684783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.684054    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d92fa2-15a1-4a14-8a8d-ec99f5528745" containerName="extract"
Sep 08 15:55:10.687407 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.687385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg"
Sep 08 15:55:10.689640 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.689619    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tl8hx\""
Sep 08 15:55:10.697905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.697879    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg"]
Sep 08 15:55:10.836100 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.836061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bhxh\" (UniqueName: \"kubernetes.io/projected/d4a66208-3a4f-4393-909d-48a9bc1419e0-kube-api-access-7bhxh\") pod \"limitador-operator-controller-manager-74495c69f8-v9vsg\" (UID: \"d4a66208-3a4f-4393-909d-48a9bc1419e0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg"
Sep 08 15:55:10.937556 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.937456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bhxh\" (UniqueName: \"kubernetes.io/projected/d4a66208-3a4f-4393-909d-48a9bc1419e0-kube-api-access-7bhxh\") pod \"limitador-operator-controller-manager-74495c69f8-v9vsg\" (UID: \"d4a66208-3a4f-4393-909d-48a9bc1419e0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg"
Sep 08 15:55:10.946035 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:10.946005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bhxh\" (UniqueName: \"kubernetes.io/projected/d4a66208-3a4f-4393-909d-48a9bc1419e0-kube-api-access-7bhxh\") pod \"limitador-operator-controller-manager-74495c69f8-v9vsg\" (UID: \"d4a66208-3a4f-4393-909d-48a9bc1419e0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg"
Sep 08 15:55:11.000486 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:11.000442    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg"
Sep 08 15:55:11.287119 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:11.287089    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg"]
Sep 08 15:55:11.288679 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:55:11.288652    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a66208_3a4f_4393_909d_48a9bc1419e0.slice/crio-3c17ee56dfbbe1c5935fa2d43f909b2f3bcc186366d68d67ab4c06f8031b2e4a WatchSource:0}: Error finding container 3c17ee56dfbbe1c5935fa2d43f909b2f3bcc186366d68d67ab4c06f8031b2e4a: Status 404 returned error can't find the container with id 3c17ee56dfbbe1c5935fa2d43f909b2f3bcc186366d68d67ab4c06f8031b2e4a
Sep 08 15:55:11.583598 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:11.583509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg" event={"ID":"d4a66208-3a4f-4393-909d-48a9bc1419e0","Type":"ContainerStarted","Data":"3c17ee56dfbbe1c5935fa2d43f909b2f3bcc186366d68d67ab4c06f8031b2e4a"}
Sep 08 15:55:12.805800 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:12.805762    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:12.906338 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:12.906306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:13.016777 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:13.016738    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:13.201946 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:13.201915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:13.300783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:13.300745    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:14.608993 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:14.608947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg" event={"ID":"d4a66208-3a4f-4393-909d-48a9bc1419e0","Type":"ContainerStarted","Data":"185e73e1c68cac1ceeedb3e0916cf41a20dae1a839379b1a5d2fc11c62a473d0"}
Sep 08 15:55:14.609458 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:14.609094    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg"
Sep 08 15:55:14.631083 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:14.631022    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg" podStartSLOduration=2.123160706 podStartE2EDuration="4.631001971s" totalImagesPullingTime="2.507841265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:55:14.6283439 +0000 UTC m=+642.750499518" watchObservedRunningTime="2026-09-08 15:55:14.631001971 +0000 UTC m=+642.753157586"
Sep 08 15:55:16.022300 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:16.022266    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:19.999603 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:19.999568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:22.607921 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:22.607883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:22.675929 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:22.675896    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:25.616983 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:25.616952    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v9vsg"
Sep 08 15:55:28.606926 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:28.606887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:28.709432 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:28.709387    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:29.049994 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.049945    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c97k4"]
Sep 08 15:55:29.050193 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.050170    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4" podUID="b949f4d2-204d-4dae-b944-5b826940c1f0" containerName="manager" containerID="cri-o://4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b" gracePeriod=10
Sep 08 15:55:29.300102 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.300032    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4"
Sep 08 15:55:29.409636 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.409596    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7jlv\" (UniqueName: \"kubernetes.io/projected/b949f4d2-204d-4dae-b944-5b826940c1f0-kube-api-access-m7jlv\") pod \"b949f4d2-204d-4dae-b944-5b826940c1f0\" (UID: \"b949f4d2-204d-4dae-b944-5b826940c1f0\") "
Sep 08 15:55:29.411905 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.411872    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b949f4d2-204d-4dae-b944-5b826940c1f0-kube-api-access-m7jlv" (OuterVolumeSpecName: "kube-api-access-m7jlv") pod "b949f4d2-204d-4dae-b944-5b826940c1f0" (UID: "b949f4d2-204d-4dae-b944-5b826940c1f0"). InnerVolumeSpecName "kube-api-access-m7jlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:55:29.510577 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.510528    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7jlv\" (UniqueName: \"kubernetes.io/projected/b949f4d2-204d-4dae-b944-5b826940c1f0-kube-api-access-m7jlv\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:55:29.697346 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.697312    2581 generic.go:356] "Generic (PLEG): container finished" podID="b949f4d2-204d-4dae-b944-5b826940c1f0" containerID="4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b" exitCode=0
Sep 08 15:55:29.697754 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.697354    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4"
Sep 08 15:55:29.697754 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.697393    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4" event={"ID":"b949f4d2-204d-4dae-b944-5b826940c1f0","Type":"ContainerDied","Data":"4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b"}
Sep 08 15:55:29.697754 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.697444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-c97k4" event={"ID":"b949f4d2-204d-4dae-b944-5b826940c1f0","Type":"ContainerDied","Data":"8bdc2f085bfe8aa655eb2d700e3e99647bf971afb1dd0bff87add1bfc9ded8d7"}
Sep 08 15:55:29.697754 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.697468    2581 scope.go:117] "RemoveContainer" containerID="4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b"
Sep 08 15:55:29.707572 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.707548    2581 scope.go:117] "RemoveContainer" containerID="4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b"
Sep 08 15:55:29.707931 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:55:29.707908    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b\": container with ID starting with 4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b not found: ID does not exist" containerID="4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b"
Sep 08 15:55:29.708001 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.707939    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b"} err="failed to get container status \"4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b\": rpc error: code = NotFound desc = could not find container \"4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b\": container with ID starting with 4f0a95ba17d52e103d04a7673a6dec649dafc9aed0317ff37dbd3c7554dd341b not found: ID does not exist"
Sep 08 15:55:29.751839 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.751790    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c97k4"]
Sep 08 15:55:29.763078 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.763044    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c97k4"]
Sep 08 15:55:29.793096 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.793064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:29.884232 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:29.884200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:30.365787 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:30.365742    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b949f4d2-204d-4dae-b944-5b826940c1f0" path="/var/lib/kubelet/pods/b949f4d2-204d-4dae-b944-5b826940c1f0/volumes"
Sep 08 15:55:33.177015 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:33.176980    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:33.233019 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:33.232982    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:33.790761 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:33.790721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:33.892596 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:33.892564    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:38.864091 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:38.864053    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:38.964634 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:38.964597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:41.028254 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.028217    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"]
Sep 08 15:55:41.028676 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.028461    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb" podUID="8cd6527c-f21d-4b94-87f6-2f4d9c19f085" containerName="manager" containerID="cri-o://044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718" gracePeriod=10
Sep 08 15:55:41.284716 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.284656    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:55:41.332615 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.332576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:41.417411 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.417376    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-extensions-socket-volume\") pod \"8cd6527c-f21d-4b94-87f6-2f4d9c19f085\" (UID: \"8cd6527c-f21d-4b94-87f6-2f4d9c19f085\") "
Sep 08 15:55:41.417615 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.417433    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkw2t\" (UniqueName: \"kubernetes.io/projected/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-kube-api-access-jkw2t\") pod \"8cd6527c-f21d-4b94-87f6-2f4d9c19f085\" (UID: \"8cd6527c-f21d-4b94-87f6-2f4d9c19f085\") "
Sep 08 15:55:41.417847 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.417792    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8cd6527c-f21d-4b94-87f6-2f4d9c19f085" (UID: "8cd6527c-f21d-4b94-87f6-2f4d9c19f085"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:55:41.419500 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.419477    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-kube-api-access-jkw2t" (OuterVolumeSpecName: "kube-api-access-jkw2t") pod "8cd6527c-f21d-4b94-87f6-2f4d9c19f085" (UID: "8cd6527c-f21d-4b94-87f6-2f4d9c19f085"). InnerVolumeSpecName "kube-api-access-jkw2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:55:41.479671 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.479639    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:41.519230 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.519189    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkw2t\" (UniqueName: \"kubernetes.io/projected/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-kube-api-access-jkw2t\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:55:41.519230 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.519222    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd6527c-f21d-4b94-87f6-2f4d9c19f085-extensions-socket-volume\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:55:41.764739 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.764706    2581 generic.go:356] "Generic (PLEG): container finished" podID="8cd6527c-f21d-4b94-87f6-2f4d9c19f085" containerID="044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718" exitCode=0
Sep 08 15:55:41.764915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.764750    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"
Sep 08 15:55:41.764915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.764797    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb" event={"ID":"8cd6527c-f21d-4b94-87f6-2f4d9c19f085","Type":"ContainerDied","Data":"044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718"}
Sep 08 15:55:41.764915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.764875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb" event={"ID":"8cd6527c-f21d-4b94-87f6-2f4d9c19f085","Type":"ContainerDied","Data":"f987f2452d5caf1ffba94fb9ba59c6f6115ff6f10d133d0cfcf541acb9718a74"}
Sep 08 15:55:41.764915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.764902    2581 scope.go:117] "RemoveContainer" containerID="044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718"
Sep 08 15:55:41.774962 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.774941    2581 scope.go:117] "RemoveContainer" containerID="044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718"
Sep 08 15:55:41.781248 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:55:41.775269    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718\": container with ID starting with 044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718 not found: ID does not exist" containerID="044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718"
Sep 08 15:55:41.781248 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.775749    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718"} err="failed to get container status \"044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718\": rpc error: code = NotFound desc = could not find container \"044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718\": container with ID starting with 044081796efc1acd8fd08b24d8669c099eb75cfff1e3dc8c4492bbb6f4248718 not found: ID does not exist"
Sep 08 15:55:41.793563 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.793524    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"]
Sep 08 15:55:41.799325 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:41.799292    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hfbgb"]
Sep 08 15:55:42.365252 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:42.365215    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd6527c-f21d-4b94-87f6-2f4d9c19f085" path="/var/lib/kubelet/pods/8cd6527c-f21d-4b94-87f6-2f4d9c19f085/volumes"
Sep 08 15:55:44.374672 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.374625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:44.438309 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.438272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:44.777130 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.777090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:44.875582 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.875548    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:44.957940 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.957903    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:55:44.958265 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.958252    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd6527c-f21d-4b94-87f6-2f4d9c19f085" containerName="manager"
Sep 08 15:55:44.958317 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.958267    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd6527c-f21d-4b94-87f6-2f4d9c19f085" containerName="manager"
Sep 08 15:55:44.958317 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.958279    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b949f4d2-204d-4dae-b944-5b826940c1f0" containerName="manager"
Sep 08 15:55:44.958317 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.958284    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b949f4d2-204d-4dae-b944-5b826940c1f0" containerName="manager"
Sep 08 15:55:44.958416 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.958345    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b949f4d2-204d-4dae-b944-5b826940c1f0" containerName="manager"
Sep 08 15:55:44.958416 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.958351    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd6527c-f21d-4b94-87f6-2f4d9c19f085" containerName="manager"
Sep 08 15:55:44.962673 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.962652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l"
Sep 08 15:55:44.964764 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.964736    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 15:55:44.964969 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.964770    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9sb96\""
Sep 08 15:55:44.968715 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:44.968689    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:55:45.048649 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.048565    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fbd47961-5163-4de8-b6a8-5f5677f7d2cb-config-file\") pod \"limitador-limitador-84994f7ffc-jg79l\" (UID: \"fbd47961-5163-4de8-b6a8-5f5677f7d2cb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l"
Sep 08 15:55:45.048649 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.048611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trcz7\" (UniqueName: \"kubernetes.io/projected/fbd47961-5163-4de8-b6a8-5f5677f7d2cb-kube-api-access-trcz7\") pod \"limitador-limitador-84994f7ffc-jg79l\" (UID: \"fbd47961-5163-4de8-b6a8-5f5677f7d2cb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l"
Sep 08 15:55:45.049252 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.049230    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:55:45.150092 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.150046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trcz7\" (UniqueName: \"kubernetes.io/projected/fbd47961-5163-4de8-b6a8-5f5677f7d2cb-kube-api-access-trcz7\") pod \"limitador-limitador-84994f7ffc-jg79l\" (UID: \"fbd47961-5163-4de8-b6a8-5f5677f7d2cb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l"
Sep 08 15:55:45.150280 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.150168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fbd47961-5163-4de8-b6a8-5f5677f7d2cb-config-file\") pod \"limitador-limitador-84994f7ffc-jg79l\" (UID: \"fbd47961-5163-4de8-b6a8-5f5677f7d2cb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l"
Sep 08 15:55:45.150959 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.150927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fbd47961-5163-4de8-b6a8-5f5677f7d2cb-config-file\") pod \"limitador-limitador-84994f7ffc-jg79l\" (UID: \"fbd47961-5163-4de8-b6a8-5f5677f7d2cb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l"
Sep 08 15:55:45.162744 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.162712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trcz7\" (UniqueName: \"kubernetes.io/projected/fbd47961-5163-4de8-b6a8-5f5677f7d2cb-kube-api-access-trcz7\") pod \"limitador-limitador-84994f7ffc-jg79l\" (UID: \"fbd47961-5163-4de8-b6a8-5f5677f7d2cb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l"
Sep 08 15:55:45.186033 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.185996    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:45.247200 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.247164    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:45.274012 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.273976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l"
Sep 08 15:55:45.549329 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.549292    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:55:45.550976 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:55:45.550946    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd47961_5163_4de8_b6a8_5f5677f7d2cb.slice/crio-f7f13842b2621e833fedf3855010b6ee2d89d87f6ce5aeae08ce7a42f61c9ab0 WatchSource:0}: Error finding container f7f13842b2621e833fedf3855010b6ee2d89d87f6ce5aeae08ce7a42f61c9ab0: Status 404 returned error can't find the container with id f7f13842b2621e833fedf3855010b6ee2d89d87f6ce5aeae08ce7a42f61c9ab0
Sep 08 15:55:45.553511 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.553489    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:55:45.792941 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:45.792900    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l" event={"ID":"fbd47961-5163-4de8-b6a8-5f5677f7d2cb","Type":"ContainerStarted","Data":"f7f13842b2621e833fedf3855010b6ee2d89d87f6ce5aeae08ce7a42f61c9ab0"}
Sep 08 15:55:46.110009 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.109919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:46.235262 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.235228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:46.432717 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.432678    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"]
Sep 08 15:55:46.439916 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.439886    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.442511 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.442486    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ef1190-openshift-default-dockercfg-4kpkk\""
Sep 08 15:55:46.448815 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.448781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"]
Sep 08 15:55:46.464180 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.464147    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:46.562541 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.562500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d2504fc-94ab-41ac-9a10-328e5362498a-istiod-ca-cert\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.563047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.562559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-token\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.563047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.562653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-socket\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.563047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.562713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-credential-socket\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.563047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.562745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-certs\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.563047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.562778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6nhq\" (UniqueName: \"kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-kube-api-access-r6nhq\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.563047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.562797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-data\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.563047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.562816    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-envoy\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.563047 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.562879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-podinfo\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.663404 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.663361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-socket\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.663576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.663433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-credential-socket\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.663576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.663466    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-certs\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.663576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.663513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6nhq\" (UniqueName: \"kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-kube-api-access-r6nhq\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.663576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.663542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-data\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.663576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.663572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-envoy\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.663854 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.663600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-podinfo\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.663854 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.663634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d2504fc-94ab-41ac-9a10-328e5362498a-istiod-ca-cert\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.663854 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.663689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-token\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.663854 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.663764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-socket\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.664072 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.664048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-data\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.664419 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.664395    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-credential-socket\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.664753 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.664693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-certs\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.665138 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.665112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d2504fc-94ab-41ac-9a10-328e5362498a-istiod-ca-cert\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.667442 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.667414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-envoy\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.667714 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.667693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-podinfo\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.678986 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.678951    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-token\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.679132 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.679065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6nhq\" (UniqueName: \"kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-kube-api-access-r6nhq\") pod \"e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") " pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.719478 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.719442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:46.756062 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.756016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:46.802042 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.802007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l" event={"ID":"fbd47961-5163-4de8-b6a8-5f5677f7d2cb","Type":"ContainerStarted","Data":"13613f43e2a0a76ea569d42b600ee2ff836e15ebe73df95c42df832098eef7ab"}
Sep 08 15:55:46.802235 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.802153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l"
Sep 08 15:55:46.823652 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:46.823597    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l" podStartSLOduration=1.729073724 podStartE2EDuration="2.823580029s" totalImagesPullingTime="1.094506305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:55:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:55:46.819643311 +0000 UTC m=+674.941798926" watchObservedRunningTime="2026-09-08 15:55:46.823580029 +0000 UTC m=+674.945735644"
Sep 08 15:55:47.053319 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:47.053284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"]
Sep 08 15:55:47.054523 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:55:47.054493    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2504fc_94ab_41ac_9a10_328e5362498a.slice/crio-267811190df225a4ed2b3154be470e0e5e57522eaf1757bcde359690fec1eeba WatchSource:0}: Error finding container 267811190df225a4ed2b3154be470e0e5e57522eaf1757bcde359690fec1eeba: Status 404 returned error can't find the container with id 267811190df225a4ed2b3154be470e0e5e57522eaf1757bcde359690fec1eeba
Sep 08 15:55:47.533077 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:47.533047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:47.633187 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:47.633145    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:47.808763 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:47.808674    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" event={"ID":"9d2504fc-94ab-41ac-9a10-328e5362498a","Type":"ContainerStarted","Data":"267811190df225a4ed2b3154be470e0e5e57522eaf1757bcde359690fec1eeba"}
Sep 08 15:55:47.988249 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:47.988214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:48.056929 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:48.056888    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7959-140182330835888"]
Sep 08 15:55:48.060194 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:48.060136    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7959-140182330835888"
Sep 08 15:55:48.062467 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:48.062445    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5nm68\""
Sep 08 15:55:48.067258 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:48.067220    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7959-140182330835888"]
Sep 08 15:55:48.175545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:48.175499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqmbl\" (UniqueName: \"kubernetes.io/projected/14627cde-fc20-473d-975a-45ac7407cf98-kube-api-access-sqmbl\") pod \"test-curl-7959-140182330835888\" (UID: \"14627cde-fc20-473d-975a-45ac7407cf98\") " pod="opendatahub/test-curl-7959-140182330835888"
Sep 08 15:55:48.276285 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:48.276247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqmbl\" (UniqueName: \"kubernetes.io/projected/14627cde-fc20-473d-975a-45ac7407cf98-kube-api-access-sqmbl\") pod \"test-curl-7959-140182330835888\" (UID: \"14627cde-fc20-473d-975a-45ac7407cf98\") " pod="opendatahub/test-curl-7959-140182330835888"
Sep 08 15:55:48.285347 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:48.285313    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqmbl\" (UniqueName: \"kubernetes.io/projected/14627cde-fc20-473d-975a-45ac7407cf98-kube-api-access-sqmbl\") pod \"test-curl-7959-140182330835888\" (UID: \"14627cde-fc20-473d-975a-45ac7407cf98\") " pod="opendatahub/test-curl-7959-140182330835888"
Sep 08 15:55:48.371233 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:48.371149    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7959-140182330835888"
Sep 08 15:55:48.642757 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:48.642725    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7959-140182330835888"]
Sep 08 15:55:48.644632 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:55:48.644605    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14627cde_fc20_473d_975a_45ac7407cf98.slice/crio-d08b38db3bec002613761d1230420eabb9aaf973c894f5d668ce3c0d0903d104 WatchSource:0}: Error finding container d08b38db3bec002613761d1230420eabb9aaf973c894f5d668ce3c0d0903d104: Status 404 returned error can't find the container with id d08b38db3bec002613761d1230420eabb9aaf973c894f5d668ce3c0d0903d104
Sep 08 15:55:48.816245 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:48.816209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7959-140182330835888" event={"ID":"14627cde-fc20-473d-975a-45ac7407cf98","Type":"ContainerStarted","Data":"d08b38db3bec002613761d1230420eabb9aaf973c894f5d668ce3c0d0903d104"}
Sep 08 15:55:49.823028 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:49.822987    2581 generic.go:356] "Generic (PLEG): container finished" podID="14627cde-fc20-473d-975a-45ac7407cf98" containerID="4edbe4b10824aa856b510b56e77755a1239c11d005c936f897f20d9617ab2341" exitCode=0
Sep 08 15:55:49.823447 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:49.823082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7959-140182330835888" event={"ID":"14627cde-fc20-473d-975a-45ac7407cf98","Type":"ContainerDied","Data":"4edbe4b10824aa856b510b56e77755a1239c11d005c936f897f20d9617ab2341"}
Sep 08 15:55:50.994250 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:50.994211    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7959-140182330835888"
Sep 08 15:55:51.022787 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:51.022756    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7959-140182330835888_14627cde-fc20-473d-975a-45ac7407cf98/test-curl-7959-140182330835888/0.log"
Sep 08 15:55:51.046896 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:51.046845    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7959-140182330835888"]
Sep 08 15:55:51.050044 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:51.050013    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7959-140182330835888"]
Sep 08 15:55:51.103807 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:51.103721    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqmbl\" (UniqueName: \"kubernetes.io/projected/14627cde-fc20-473d-975a-45ac7407cf98-kube-api-access-sqmbl\") pod \"14627cde-fc20-473d-975a-45ac7407cf98\" (UID: \"14627cde-fc20-473d-975a-45ac7407cf98\") "
Sep 08 15:55:51.105915 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:51.105882    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14627cde-fc20-473d-975a-45ac7407cf98-kube-api-access-sqmbl" (OuterVolumeSpecName: "kube-api-access-sqmbl") pod "14627cde-fc20-473d-975a-45ac7407cf98" (UID: "14627cde-fc20-473d-975a-45ac7407cf98"). InnerVolumeSpecName "kube-api-access-sqmbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:55:51.204526 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:51.204487    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqmbl\" (UniqueName: \"kubernetes.io/projected/14627cde-fc20-473d-975a-45ac7407cf98-kube-api-access-sqmbl\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:55:51.841429 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:51.841395    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7959-140182330835888"
Sep 08 15:55:51.841429 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:51.841419    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d08b38db3bec002613761d1230420eabb9aaf973c894f5d668ce3c0d0903d104"
Sep 08 15:55:51.854026 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:55:51.853973    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7959-140182330835888\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="14627cde-fc20-473d-975a-45ac7407cf98" pod="opendatahub/test-curl-7959-140182330835888"
Sep 08 15:55:52.189121 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:52.189081    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:55:52.189411 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:52.189162    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:55:52.189411 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:52.189193    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:55:52.365984 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:52.365949    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14627cde-fc20-473d-975a-45ac7407cf98" path="/var/lib/kubelet/pods/14627cde-fc20-473d-975a-45ac7407cf98/volumes"
Sep 08 15:55:52.366315 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:55:52.366282    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7959-140182330835888\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="14627cde-fc20-473d-975a-45ac7407cf98" pod="opendatahub/test-curl-7959-140182330835888"
Sep 08 15:55:52.849168 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:52.849128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" event={"ID":"9d2504fc-94ab-41ac-9a10-328e5362498a","Type":"ContainerStarted","Data":"e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0"}
Sep 08 15:55:52.875473 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:52.875423    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" podStartSLOduration=1.743264082 podStartE2EDuration="6.875407592s" totalImagesPullingTime="5.13214351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:55:52.874568367 +0000 UTC m=+680.996723983" watchObservedRunningTime="2026-09-08 15:55:52.875407592 +0000 UTC m=+680.997563207"
Sep 08 15:55:53.756736 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:53.756704    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:53.761491 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:53.761465    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:53.854481 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:53.854454    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:53.855575 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:53.855551    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:55:54.178746 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:54.178711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:54.277702 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:54.277664    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:54.388087 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:54.388052    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:54.485103 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:54.485017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:54.577526 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:54.577496    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:54.794556 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:54.794476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:54.989765 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:54.989729    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:55.083050 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.082963    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:55.185106 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.185072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:55.236719 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.236682    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"]
Sep 08 15:55:55.237113 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.237099    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14627cde-fc20-473d-975a-45ac7407cf98" containerName="test-curl-7959-140182330835888"
Sep 08 15:55:55.237171 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.237115    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="14627cde-fc20-473d-975a-45ac7407cf98" containerName="test-curl-7959-140182330835888"
Sep 08 15:55:55.237207 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.237179    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="14627cde-fc20-473d-975a-45ac7407cf98" containerName="test-curl-7959-140182330835888"
Sep 08 15:55:55.240581 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.240556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.242850 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.242805    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-423c90-openshift-default-dockercfg-v5c2j\""
Sep 08 15:55:55.256274 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.256241    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"]
Sep 08 15:55:55.278575 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.278543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:55.343553 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.343452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-data\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.343553 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.343523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-socket\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.343780 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.343563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-envoy\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.343780 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.343594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58df83f1-e36d-45e4-b004-929eb1926155-istiod-ca-cert\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.343780 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.343626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-credential-socket\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.343780 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.343653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-istio-token\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.343780 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.343713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58df83f1-e36d-45e4-b004-929eb1926155-istio-podinfo\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.343780 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.343742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-certs\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.343780 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.343770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftkpd\" (UniqueName: \"kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-kube-api-access-ftkpd\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.429041 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.428995    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:55.445322 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58df83f1-e36d-45e4-b004-929eb1926155-istio-podinfo\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.445439 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-certs\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.445439 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftkpd\" (UniqueName: \"kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-kube-api-access-ftkpd\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.445439 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-data\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.445579 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-socket\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.445634 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-envoy\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.445694 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58df83f1-e36d-45e4-b004-929eb1926155-istiod-ca-cert\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.445694 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-credential-socket\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.445816 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-istio-token\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.445913 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-certs\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.445974 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.445915    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-socket\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.446053 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.446029    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-data\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.446183 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.446085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-credential-socket\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.446372 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.446347    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58df83f1-e36d-45e4-b004-929eb1926155-istiod-ca-cert\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.447969 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.447948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-envoy\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.448209 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.448188    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58df83f1-e36d-45e4-b004-929eb1926155-istio-podinfo\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.454174 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.454145    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-istio-token\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.454393 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.454367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftkpd\" (UniqueName: \"kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-kube-api-access-ftkpd\") pod \"e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") " pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.551692 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.551654    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:55.834391 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.834363    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"]
Sep 08 15:55:55.835466 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:55:55.835443    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58df83f1_e36d_45e4_b004_929eb1926155.slice/crio-9d67c52842f537592d093e9909b0e44dd25be7b072cdb313a489d9ee0e340523 WatchSource:0}: Error finding container 9d67c52842f537592d093e9909b0e44dd25be7b072cdb313a489d9ee0e340523: Status 404 returned error can't find the container with id 9d67c52842f537592d093e9909b0e44dd25be7b072cdb313a489d9ee0e340523
Sep 08 15:55:55.838582 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.838550    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:55:55.838681 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.838635    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:55:55.838681 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.838667    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:55:55.866987 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.866953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" event={"ID":"58df83f1-e36d-45e4-b004-929eb1926155","Type":"ContainerStarted","Data":"9d67c52842f537592d093e9909b0e44dd25be7b072cdb313a489d9ee0e340523"}
Sep 08 15:55:55.893387 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.893358    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"]
Sep 08 15:55:55.898171 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.898150    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:55.900538 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.900518    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vmx7t\""
Sep 08 15:55:55.900703 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.900558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ef1190-serving-cert\""
Sep 08 15:55:55.908279 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.908158    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"]
Sep 08 15:55:55.932096 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:55.932060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:56.033239 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.033204    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:56.050909 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.050856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bebe80b-4a7b-4403-9322-75a34a01f055-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.051079 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.051002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl78c\" (UniqueName: \"kubernetes.io/projected/8bebe80b-4a7b-4403-9322-75a34a01f055-kube-api-access-dl78c\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.051154 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.051137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.051199 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.051170    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-metrics-certs\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.152109 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.152072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl78c\" (UniqueName: \"kubernetes.io/projected/8bebe80b-4a7b-4403-9322-75a34a01f055-kube-api-access-dl78c\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.152297 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.152181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.152297 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.152210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-metrics-certs\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.152297 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.152243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bebe80b-4a7b-4403-9322-75a34a01f055-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.152502 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:55:56.152320    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-serving-cert: secret "maas-api-e2e-inf-a-ef1190-serving-cert" not found
Sep 08 15:55:56.152502 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:55:56.152398    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-maas-api-tls podName:8bebe80b-4a7b-4403-9322-75a34a01f055 nodeName:}" failed. No retries permitted until 2026-09-08 15:55:56.652381693 +0000 UTC m=+684.774537290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-maas-api-tls") pod "maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z" (UID: "8bebe80b-4a7b-4403-9322-75a34a01f055") : secret "maas-api-e2e-inf-a-ef1190-serving-cert" not found
Sep 08 15:55:56.153007 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.152984    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bebe80b-4a7b-4403-9322-75a34a01f055-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.154585 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.154565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-metrics-certs\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.163990 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.163956    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl78c\" (UniqueName: \"kubernetes.io/projected/8bebe80b-4a7b-4403-9322-75a34a01f055-kube-api-access-dl78c\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.258792 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.258755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:56.444514 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.444425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:56.550202 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.550165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:56.657503 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.657146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.660236 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.660196    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.812431 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.812334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:56.877204 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.877171    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" event={"ID":"58df83f1-e36d-45e4-b004-929eb1926155","Type":"ContainerStarted","Data":"8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18"}
Sep 08 15:55:56.908250 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:56.908187    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" podStartSLOduration=1.908169926 podStartE2EDuration="1.908169926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:55:56.896333527 +0000 UTC m=+685.018489142" watchObservedRunningTime="2026-09-08 15:55:56.908169926 +0000 UTC m=+685.030325541"
Sep 08 15:55:57.092422 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:57.092392    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"]
Sep 08 15:55:57.093932 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:55:57.093905    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bebe80b_4a7b_4403_9322_75a34a01f055.slice/crio-c500dc4955cc2b592fdb163755d6dcec924aea3edc849ccbbd7f563ab198eedb WatchSource:0}: Error finding container c500dc4955cc2b592fdb163755d6dcec924aea3edc849ccbbd7f563ab198eedb: Status 404 returned error can't find the container with id c500dc4955cc2b592fdb163755d6dcec924aea3edc849ccbbd7f563ab198eedb
Sep 08 15:55:57.552160 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:57.552124    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:57.557335 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:57.557299    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:57.810408 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:57.810322    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-jg79l"
Sep 08 15:55:57.884751 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:57.884714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z" event={"ID":"8bebe80b-4a7b-4403-9322-75a34a01f055","Type":"ContainerStarted","Data":"c500dc4955cc2b592fdb163755d6dcec924aea3edc849ccbbd7f563ab198eedb"}
Sep 08 15:55:57.885159 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:57.884905    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:57.885812 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:57.885792    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:55:58.330142 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:58.330112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:58.798347 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:58.798296    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:58.892081 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:58.892046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:58.892715 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:58.892686    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z" event={"ID":"8bebe80b-4a7b-4403-9322-75a34a01f055","Type":"ContainerStarted","Data":"a5d34bb039318397f1ff818302ec017e9cb39cec498a7738c41cd54375ecac45"}
Sep 08 15:55:58.893004 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:58.892985    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:55:58.911783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:58.911721    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z" podStartSLOduration=2.741875834 podStartE2EDuration="3.911704573s" totalImagesPullingTime="1.169828739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:55:58.910617013 +0000 UTC m=+687.032772629" watchObservedRunningTime="2026-09-08 15:55:58.911704573 +0000 UTC m=+687.033860243"
Sep 08 15:55:59.907286 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:59.907251    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"]
Sep 08 15:55:59.911624 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:59.911589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:55:59.914017 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:59.913981    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-423c90-serving-cert\""
Sep 08 15:55:59.923204 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:59.923079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"]
Sep 08 15:55:59.990351 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:59.990307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-maas-api-tls\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:55:59.990576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:59.990365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-metrics-certs\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:55:59.990576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:59.990496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79785e01-22bf-4660-9075-826086cce922-openshift-service-ca\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:55:59.990576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:55:59.990550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjhrk\" (UniqueName: \"kubernetes.io/projected/79785e01-22bf-4660-9075-826086cce922-kube-api-access-hjhrk\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.091220 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.091180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79785e01-22bf-4660-9075-826086cce922-openshift-service-ca\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.091220 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.091230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjhrk\" (UniqueName: \"kubernetes.io/projected/79785e01-22bf-4660-9075-826086cce922-kube-api-access-hjhrk\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.091455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.091304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-maas-api-tls\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.091455 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:56:00.091388    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-423c90-serving-cert: secret "maas-api-e2e-autores-423c90-serving-cert" not found
Sep 08 15:56:00.091455 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:56:00.091446    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-maas-api-tls podName:79785e01-22bf-4660-9075-826086cce922 nodeName:}" failed. No retries permitted until 2026-09-08 15:56:00.591425095 +0000 UTC m=+688.713580689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-maas-api-tls") pod "maas-api-e2e-autores-423c90-6558554bb9-hzgv8" (UID: "79785e01-22bf-4660-9075-826086cce922") : secret "maas-api-e2e-autores-423c90-serving-cert" not found
Sep 08 15:56:00.091598 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.091459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-metrics-certs\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.091963 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.091940    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79785e01-22bf-4660-9075-826086cce922-openshift-service-ca\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.093997 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.093970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-metrics-certs\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.101880 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.101856    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjhrk\" (UniqueName: \"kubernetes.io/projected/79785e01-22bf-4660-9075-826086cce922-kube-api-access-hjhrk\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.595739 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.595696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-maas-api-tls\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.598153 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.598128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-maas-api-tls\") pod \"maas-api-e2e-autores-423c90-6558554bb9-hzgv8\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.826846 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.826773    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:00.944245 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:00.944188    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:01.035495 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:01.035458    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:01.102538 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:01.102508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"]
Sep 08 15:56:01.104114 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:56:01.104049    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79785e01_22bf_4660_9075_826086cce922.slice/crio-2a8711d4a36f51eadf5b86b6a5da3bc40137299240b3d47b3ecf95b1ae1e4280 WatchSource:0}: Error finding container 2a8711d4a36f51eadf5b86b6a5da3bc40137299240b3d47b3ecf95b1ae1e4280: Status 404 returned error can't find the container with id 2a8711d4a36f51eadf5b86b6a5da3bc40137299240b3d47b3ecf95b1ae1e4280
Sep 08 15:56:01.262572 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:01.262533    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:01.484983 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:01.484936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:01.583904 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:01.583768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:01.874119 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:01.874027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:01.921636 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:01.921598    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8" event={"ID":"79785e01-22bf-4660-9075-826086cce922","Type":"ContainerStarted","Data":"2a8711d4a36f51eadf5b86b6a5da3bc40137299240b3d47b3ecf95b1ae1e4280"}
Sep 08 15:56:01.985303 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:01.985269    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:02.074072 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:02.074039    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:02.219381 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:02.219346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:02.733504 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:02.733469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:03.934365 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:03.934331    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8" event={"ID":"79785e01-22bf-4660-9075-826086cce922","Type":"ContainerStarted","Data":"7c04c50c490c7d3e4c806b41ac78297e9481ad262b62a65ca21bdd40d11d5b8d"}
Sep 08 15:56:03.934758 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:03.934461    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:03.950723 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:03.950672    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8" podStartSLOduration=2.545692667 podStartE2EDuration="4.950654849s" totalImagesPullingTime="2.404962182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:56:03.949977512 +0000 UTC m=+692.072133128" watchObservedRunningTime="2026-09-08 15:56:03.950654849 +0000 UTC m=+692.072810464"
Sep 08 15:56:04.785161 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:04.785120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:04.884625 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:04.884584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:04.905976 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:04.905948    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 15:56:08.475165 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:08.475122    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:08.574193 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:08.574162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:09.578065 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:09.578020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:09.678836 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:09.678789    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:09.965123 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:09.965083    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:56:09.983980 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:09.983942    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:10.286088 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:10.285997    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:10.385978 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:10.385950    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:10.468237 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:10.468203    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:13.927051 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:13.927005    2581 patch_prober.go:28] interesting pod/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:56:13.927563 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:13.927081    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:56:15.599376 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:15.599341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:56:16.030038 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.030003    2581 generic.go:356] "Generic (PLEG): container finished" podID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerID="e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0" exitCode=0
Sep 08 15:56:16.030230 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.030081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" event={"ID":"9d2504fc-94ab-41ac-9a10-328e5362498a","Type":"ContainerDied","Data":"e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0"}
Sep 08 15:56:16.030566 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.030542    2581 scope.go:117] "RemoveContainer" containerID="e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0"
Sep 08 15:56:16.031783 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.031745    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:56:16.031891 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.031842    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:56:16.031891 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.031877    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:56:16.031980 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.031905    2581 generic.go:356] "Generic (PLEG): container finished" podID="58df83f1-e36d-45e4-b004-929eb1926155" containerID="8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18" exitCode=0
Sep 08 15:56:16.032033 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.031989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" event={"ID":"58df83f1-e36d-45e4-b004-929eb1926155","Type":"ContainerDied","Data":"8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18"}
Sep 08 15:56:16.032357 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.032340    2581 scope.go:117] "RemoveContainer" containerID="8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18"
Sep 08 15:56:16.033349 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.033322    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:56:16.033422 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.033392    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:56:16.033461 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.033435    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:56:16.848059 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:16.848021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:17.048581 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:17.047605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" event={"ID":"58df83f1-e36d-45e4-b004-929eb1926155","Type":"ContainerStarted","Data":"970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc"}
Sep 08 15:56:17.051564 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:17.051526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" event={"ID":"9d2504fc-94ab-41ac-9a10-328e5362498a","Type":"ContainerStarted","Data":"24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48"}
Sep 08 15:56:17.552188 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:17.552145    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:56:17.552415 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:17.552286    2581 patch_prober.go:28] interesting pod/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:56:17.552415 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:17.552333    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 08 15:56:17.756488 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:17.756439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:56:17.756702 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:17.756589    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:56:17.756702 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:17.756636    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 08 15:56:18.552908 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:18.552854    2581 patch_prober.go:28] interesting pod/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:56:18.553439 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:18.552938    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 08 15:56:18.757031 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:18.756986    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:56:18.757243 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:18.757058    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 08 15:56:19.553104 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:19.553062    2581 patch_prober.go:28] interesting pod/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:56:19.553727 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:19.553693    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 08 15:56:19.716628 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:19.716577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:19.756943 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:19.756891    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:56:19.757281 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:19.757235    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 08 15:56:20.036348 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:20.036293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:20.356034 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:20.355937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:20.552276 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:20.552232    2581 patch_prober.go:28] interesting pod/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:56:20.552498 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:20.552298    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 08 15:56:20.756895 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:20.756849    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:56:20.757405 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:20.756923    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 08 15:56:20.858173 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:20.858090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:20.960883 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:20.960804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:21.553190 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:21.553153    2581 patch_prober.go:28] interesting pod/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 08 15:56:21.553522 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:21.553485    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 08 15:56:21.757410 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:21.757372    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:56:21.758033 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:21.757995    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 08 15:56:22.087780 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.087748    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:22.204964 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.204931    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:22.304939 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.304902    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:22.693539 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.693504    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:56:22.694001 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.693970    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:56:22.696746 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.696711    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:56:22.766007 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.765971    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:56:22.766971 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.766947    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:56:22.769240 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.769217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 15:56:22.860415 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.860379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:22.959961 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:22.959869    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:23.118631 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:23.118593    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:23.603769 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:23.603729    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:23.704881 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:23.704846    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:23.804532 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:23.804491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:23.914496 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:23.914455    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:24.632348 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.632307    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"]
Sep 08 15:56:24.637759 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.637733    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.639714 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.639688    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c96e2b-serving-cert\""
Sep 08 15:56:24.648675 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.648641    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"]
Sep 08 15:56:24.675300 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.675252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:24.730756 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.730718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqjqd\" (UniqueName: \"kubernetes.io/projected/bd5c3acb-2f2e-496a-969c-b8c1a948196c-kube-api-access-pqjqd\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.730967 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.730791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-metrics-certs\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.730967 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.730857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd5c3acb-2f2e-496a-969c-b8c1a948196c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.730967 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.730919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-maas-api-tls\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.773325 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.773266    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:24.832439 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.832399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-maas-api-tls\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.832985 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.832449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqjqd\" (UniqueName: \"kubernetes.io/projected/bd5c3acb-2f2e-496a-969c-b8c1a948196c-kube-api-access-pqjqd\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.832985 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.832600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-metrics-certs\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.832985 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.832651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd5c3acb-2f2e-496a-969c-b8c1a948196c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.833442 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.833417    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd5c3acb-2f2e-496a-969c-b8c1a948196c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.835123 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.835101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-maas-api-tls\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.835218 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.835144    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-metrics-certs\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.840858 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.840832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqjqd\" (UniqueName: \"kubernetes.io/projected/bd5c3acb-2f2e-496a-969c-b8c1a948196c-kube-api-access-pqjqd\") pod \"maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:24.886631 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.886516    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:24.951678 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:24.951643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:25.119036 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:25.118998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:25.199957 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:25.199926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:25.232484 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:25.232452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"]
Sep 08 15:56:25.235021 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:56:25.234989    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5c3acb_2f2e_496a_969c_b8c1a948196c.slice/crio-d7f5ab642c2e5422e9d0cbe7e0f7a6b1f348d7ca8eeb15b72960763b7953100a WatchSource:0}: Error finding container d7f5ab642c2e5422e9d0cbe7e0f7a6b1f348d7ca8eeb15b72960763b7953100a: Status 404 returned error can't find the container with id d7f5ab642c2e5422e9d0cbe7e0f7a6b1f348d7ca8eeb15b72960763b7953100a
Sep 08 15:56:25.281716 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:25.281665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:25.721799 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:25.721762    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:26.111388 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:26.111351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d" event={"ID":"bd5c3acb-2f2e-496a-969c-b8c1a948196c","Type":"ContainerStarted","Data":"cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31"}
Sep 08 15:56:26.111866 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:26.111408    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d" event={"ID":"bd5c3acb-2f2e-496a-969c-b8c1a948196c","Type":"ContainerStarted","Data":"d7f5ab642c2e5422e9d0cbe7e0f7a6b1f348d7ca8eeb15b72960763b7953100a"}
Sep 08 15:56:26.111866 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:26.111435    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:26.134065 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:26.134004    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d" podStartSLOduration=1.809387569 podStartE2EDuration="2.13398832s" totalImagesPullingTime="324.600751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:56:26.131436872 +0000 UTC m=+714.253592487" watchObservedRunningTime="2026-09-08 15:56:26.13398832 +0000 UTC m=+714.256143934"
Sep 08 15:56:26.544337 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:26.544305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:27.100764 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:27.100728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:28.284629 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:28.284593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:56:28.717579 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:28.717538    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:32.124007 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:32.123977    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 15:56:41.144266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:41.144231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:41.800058 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:41.800012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:41.899721 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:41.899687    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:42.004773 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:42.004714    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:42.323964 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:42.323927    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:42.398546 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:42.398513    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:42.692281 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:42.692242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:42.788020 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:42.787990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:42.891067 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:42.891034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:43.209266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:43.209230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:43.931245 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:43.931209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:45.626691 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:45.626656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:45.997303 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:45.997273    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:46.098006 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:46.097974    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:46.341620 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:46.341534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:46.445071 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:46.445036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:46.542960 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:46.542926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:46.859373 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:46.859339    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:47.284644 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:47.284608    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:56:48.362342 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:48.362311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:48.526778 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:48.526747    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:52.403185 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:56:52.403147    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:05.768727 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:05.768687    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:06.280904 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:06.280864    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:57:17.710841 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:17.710751    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:17.813219 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:17.813180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:17.911003 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:17.910971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:18.012400 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:18.012278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:18.094259 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:18.094228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:19.083380 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:19.083346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:19.184647 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:19.184615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:21.091444 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:21.091412    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:21.194883 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:21.194815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:23.870123 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:23.870076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:23.902099 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:23.902058    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:57:23.941429 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:23.941392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:27.009403 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:27.009352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:37.416506 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.416465    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"]
Sep 08 15:57:37.416936 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.416733    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8" podUID="79785e01-22bf-4660-9075-826086cce922" containerName="maas-api" containerID="cri-o://7c04c50c490c7d3e4c806b41ac78297e9481ad262b62a65ca21bdd40d11d5b8d" gracePeriod=30
Sep 08 15:57:37.444596 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.444547    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:37.550022 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.549989    2581 generic.go:356] "Generic (PLEG): container finished" podID="79785e01-22bf-4660-9075-826086cce922" containerID="7c04c50c490c7d3e4c806b41ac78297e9481ad262b62a65ca21bdd40d11d5b8d" exitCode=0
Sep 08 15:57:37.550226 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.550060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8" event={"ID":"79785e01-22bf-4660-9075-826086cce922","Type":"ContainerDied","Data":"7c04c50c490c7d3e4c806b41ac78297e9481ad262b62a65ca21bdd40d11d5b8d"}
Sep 08 15:57:37.673753 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.673666    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:57:37.824014 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.823977    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-metrics-certs\") pod \"79785e01-22bf-4660-9075-826086cce922\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") "
Sep 08 15:57:37.824206 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.824031    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79785e01-22bf-4660-9075-826086cce922-openshift-service-ca\") pod \"79785e01-22bf-4660-9075-826086cce922\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") "
Sep 08 15:57:37.824278 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.824207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-maas-api-tls\") pod \"79785e01-22bf-4660-9075-826086cce922\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") "
Sep 08 15:57:37.824355 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.824334    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjhrk\" (UniqueName: \"kubernetes.io/projected/79785e01-22bf-4660-9075-826086cce922-kube-api-access-hjhrk\") pod \"79785e01-22bf-4660-9075-826086cce922\" (UID: \"79785e01-22bf-4660-9075-826086cce922\") "
Sep 08 15:57:37.824417 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.824383    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79785e01-22bf-4660-9075-826086cce922-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "79785e01-22bf-4660-9075-826086cce922" (UID: "79785e01-22bf-4660-9075-826086cce922"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:57:37.824648 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.824628    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79785e01-22bf-4660-9075-826086cce922-openshift-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:57:37.826384 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.826345    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "79785e01-22bf-4660-9075-826086cce922" (UID: "79785e01-22bf-4660-9075-826086cce922"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:57:37.826489 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.826378    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79785e01-22bf-4660-9075-826086cce922-kube-api-access-hjhrk" (OuterVolumeSpecName: "kube-api-access-hjhrk") pod "79785e01-22bf-4660-9075-826086cce922" (UID: "79785e01-22bf-4660-9075-826086cce922"). InnerVolumeSpecName "kube-api-access-hjhrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:57:37.826489 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.826440    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "79785e01-22bf-4660-9075-826086cce922" (UID: "79785e01-22bf-4660-9075-826086cce922"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:57:37.926030 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.925935    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjhrk\" (UniqueName: \"kubernetes.io/projected/79785e01-22bf-4660-9075-826086cce922-kube-api-access-hjhrk\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:57:37.926030 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.925970    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:57:37.926030 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:37.925980    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79785e01-22bf-4660-9075-826086cce922-maas-api-tls\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:57:38.557258 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:38.557224    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"
Sep 08 15:57:38.557741 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:38.557226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8" event={"ID":"79785e01-22bf-4660-9075-826086cce922","Type":"ContainerDied","Data":"2a8711d4a36f51eadf5b86b6a5da3bc40137299240b3d47b3ecf95b1ae1e4280"}
Sep 08 15:57:38.557741 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:38.557385    2581 scope.go:117] "RemoveContainer" containerID="7c04c50c490c7d3e4c806b41ac78297e9481ad262b62a65ca21bdd40d11d5b8d"
Sep 08 15:57:38.573587 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:38.573553    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"]
Sep 08 15:57:38.576183 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:38.576154    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-423c90-6558554bb9-hzgv8"]
Sep 08 15:57:39.297435 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:39.297379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:39.397993 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:39.397961    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:39.883187 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:39.883143    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:57:40.365983 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:40.365951    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79785e01-22bf-4660-9075-826086cce922" path="/var/lib/kubelet/pods/79785e01-22bf-4660-9075-826086cce922/volumes"
Sep 08 15:57:43.076488 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:43.076436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:43.175708 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:43.175676    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:43.276341 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:43.276299    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:52.829594 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:52.829562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:52.900713 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:52.900682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:52.965088 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:52.965047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:53.029919 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:53.029881    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:53.097006 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:53.096895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:54.146854 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:54.146728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:54.186070 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:54.186038    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:57:54.574274 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:54.574231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:54.876693 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:54.876565    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:55.150513 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:55.150474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:57.331082 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:57.331038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:57.433013 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:57.432972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:58.514234 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:58.514203    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:58.571153 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:58.571116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:58.671398 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:58.671368    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:59.009989 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:59.009948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:59.094322 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:57:59.094287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:12.687480 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:12.687439    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:58:19.066224 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.066186    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"]
Sep 08 15:58:19.066623 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.066554    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79785e01-22bf-4660-9075-826086cce922" containerName="maas-api"
Sep 08 15:58:19.066623 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.066565    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="79785e01-22bf-4660-9075-826086cce922" containerName="maas-api"
Sep 08 15:58:19.066710 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.066638    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="79785e01-22bf-4660-9075-826086cce922" containerName="maas-api"
Sep 08 15:58:19.069741 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.069720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.072339 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.072315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ef1190\"/\"kube-root-ca.crt\""
Sep 08 15:58:19.073104 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.073030    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ef1190\"/\"default-dockercfg-fnmv5\""
Sep 08 15:58:19.073104 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.073068    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ef1190\"/\"openshift-service-ca.crt\""
Sep 08 15:58:19.073104 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.073076    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ef1190\"/\"test-model-ef1190-kserve-self-signed-certs\""
Sep 08 15:58:19.080906 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.080881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"]
Sep 08 15:58:19.095129 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.095101    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:19.200607 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.200570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tls-certs\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.200607 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.200610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9xg6\" (UniqueName: \"kubernetes.io/projected/4dd41b79-1008-4cd4-be97-f3c5ba71b079-kube-api-access-k9xg6\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.200903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.200646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-model-cache\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.200903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.200716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-dshm\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.200903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.200756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-home\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.200903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.200781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tmp-dir\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.301644 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.301608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-dshm\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.301847 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.301663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-home\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.301847 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.301699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tmp-dir\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.301847 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.301766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tls-certs\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.301847 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.301795    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9xg6\" (UniqueName: \"kubernetes.io/projected/4dd41b79-1008-4cd4-be97-f3c5ba71b079-kube-api-access-k9xg6\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.302085 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.301863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-model-cache\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.302192 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.302167    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-home\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.302247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.302176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tmp-dir\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.302247 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.302214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-model-cache\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.304100 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.304072    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-dshm\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.304546 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.304523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tls-certs\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.310855 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.310805    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9xg6\" (UniqueName: \"kubernetes.io/projected/4dd41b79-1008-4cd4-be97-f3c5ba71b079-kube-api-access-k9xg6\") pod \"test-model-ef1190-kserve-57499c8b6f-w7zkl\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") " pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.325545 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.325469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:19.380688 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.380653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:19.660662 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.660637    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"]
Sep 08 15:58:19.662605 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:58:19.662576    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dd41b79_1008_4cd4_be97_f3c5ba71b079.slice/crio-8257a464d7464d27b21473a6afc608b1e8f38c64db6cdf2d040daa07502b3f69 WatchSource:0}: Error finding container 8257a464d7464d27b21473a6afc608b1e8f38c64db6cdf2d040daa07502b3f69: Status 404 returned error can't find the container with id 8257a464d7464d27b21473a6afc608b1e8f38c64db6cdf2d040daa07502b3f69
Sep 08 15:58:19.806744 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.806695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl" event={"ID":"4dd41b79-1008-4cd4-be97-f3c5ba71b079","Type":"ContainerStarted","Data":"34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00"}
Sep 08 15:58:19.806966 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.806753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl" event={"ID":"4dd41b79-1008-4cd4-be97-f3c5ba71b079","Type":"ContainerStarted","Data":"8257a464d7464d27b21473a6afc608b1e8f38c64db6cdf2d040daa07502b3f69"}
Sep 08 15:58:19.826724 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:19.826668    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl" podStartSLOduration=0.826651435 podStartE2EDuration="826.651435ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:58:19.825256362 +0000 UTC m=+827.947411969" watchObservedRunningTime="2026-09-08 15:58:19.826651435 +0000 UTC m=+827.948807053"
Sep 08 15:58:20.954112 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:20.954077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:22.704135 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:22.704101    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:23.559732 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:23.559697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:23.835681 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:23.835602    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:24.700072 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:24.700036    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:58:25.913475 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:25.913437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:27.305119 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:27.305085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:27.405196 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:27.405143    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:27.572534 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:27.572433    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"]
Sep 08 15:58:27.572717 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:27.572692    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy" containerID="cri-o://970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc" gracePeriod=30
Sep 08 15:58:27.598574 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:27.598540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:28.033007 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:28.032974    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:28.326281 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:28.326206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:28.546031 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:28.545985    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:28.736286 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:28.736252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:29.381562 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:29.381521    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:29.381977 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:29.381587    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:29.396751 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:29.396722    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:29.416990 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:29.416955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:29.482634 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:29.482601    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:29.545788 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:29.545735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:29.615576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:29.615547    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:29.677677 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:29.677631    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:29.753156 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:29.753124    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:29.879720 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:29.879691    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 15:58:30.445980 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:30.445937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:30.545184 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:30.545146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:30.644163 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:30.644135    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:31.096671 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:31.096637    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:31.187963 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:31.187920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:32.076193 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.076158    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:32.423690 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.423658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:32.587993 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.587935    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:32.818278 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.818231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:32.834127 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.834104    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:58:32.889499 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.889460    2581 generic.go:356] "Generic (PLEG): container finished" podID="58df83f1-e36d-45e4-b004-929eb1926155" containerID="970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc" exitCode=0
Sep 08 15:58:32.889695 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.889520    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"
Sep 08 15:58:32.889695 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.889537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" event={"ID":"58df83f1-e36d-45e4-b004-929eb1926155","Type":"ContainerDied","Data":"970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc"}
Sep 08 15:58:32.889695 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.889603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h" event={"ID":"58df83f1-e36d-45e4-b004-929eb1926155","Type":"ContainerDied","Data":"9d67c52842f537592d093e9909b0e44dd25be7b072cdb313a489d9ee0e340523"}
Sep 08 15:58:32.889695 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.889636    2581 scope.go:117] "RemoveContainer" containerID="970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc"
Sep 08 15:58:32.902336 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.902312    2581 scope.go:117] "RemoveContainer" containerID="8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18"
Sep 08 15:58:32.911635 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.911611    2581 scope.go:117] "RemoveContainer" containerID="970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc"
Sep 08 15:58:32.912019 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:58:32.911989    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc\": container with ID starting with 970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc not found: ID does not exist" containerID="970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc"
Sep 08 15:58:32.912149 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.912033    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc"} err="failed to get container status \"970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc\": rpc error: code = NotFound desc = could not find container \"970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc\": container with ID starting with 970d97f9fde4bb6b4478ff2e879c7d77d28bb2151a7f755b4e5bf7b397c4c4fc not found: ID does not exist"
Sep 08 15:58:32.912149 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.912060    2581 scope.go:117] "RemoveContainer" containerID="8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18"
Sep 08 15:58:32.912366 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:58:32.912343    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18\": container with ID starting with 8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18 not found: ID does not exist" containerID="8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18"
Sep 08 15:58:32.912435 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.912371    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18"} err="failed to get container status \"8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18\": rpc error: code = NotFound desc = could not find container \"8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18\": container with ID starting with 8875d2f3bfdeb143bfb507a9dd746cac722631ee8c44b6438c6ee5f6cd284b18 not found: ID does not exist"
Sep 08 15:58:32.925917 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.925886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:32.940127 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940089    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-credential-socket\") pod \"58df83f1-e36d-45e4-b004-929eb1926155\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") "
Sep 08 15:58:32.940340 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940156    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-envoy\") pod \"58df83f1-e36d-45e4-b004-929eb1926155\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") "
Sep 08 15:58:32.940340 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940215    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-certs\") pod \"58df83f1-e36d-45e4-b004-929eb1926155\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") "
Sep 08 15:58:32.940340 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940252    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-data\") pod \"58df83f1-e36d-45e4-b004-929eb1926155\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") "
Sep 08 15:58:32.940340 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940334    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58df83f1-e36d-45e4-b004-929eb1926155-istiod-ca-cert\") pod \"58df83f1-e36d-45e4-b004-929eb1926155\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") "
Sep 08 15:58:32.940598 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940405    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-istio-token\") pod \"58df83f1-e36d-45e4-b004-929eb1926155\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") "
Sep 08 15:58:32.940598 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940464    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-socket\") pod \"58df83f1-e36d-45e4-b004-929eb1926155\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") "
Sep 08 15:58:32.940598 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940315    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58df83f1-e36d-45e4-b004-929eb1926155" (UID: "58df83f1-e36d-45e4-b004-929eb1926155"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:58:32.940598 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940514    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftkpd\" (UniqueName: \"kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-kube-api-access-ftkpd\") pod \"58df83f1-e36d-45e4-b004-929eb1926155\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") "
Sep 08 15:58:32.940598 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940537    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58df83f1-e36d-45e4-b004-929eb1926155" (UID: "58df83f1-e36d-45e4-b004-929eb1926155"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:58:32.940598 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940551    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-data" (OuterVolumeSpecName: "istio-data") pod "58df83f1-e36d-45e4-b004-929eb1926155" (UID: "58df83f1-e36d-45e4-b004-929eb1926155"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:58:32.940598 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940547    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58df83f1-e36d-45e4-b004-929eb1926155-istio-podinfo\") pod \"58df83f1-e36d-45e4-b004-929eb1926155\" (UID: \"58df83f1-e36d-45e4-b004-929eb1926155\") "
Sep 08 15:58:32.941006 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940982    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-credential-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:58:32.941178 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.941162    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:58:32.941311 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.941294    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-data\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:58:32.941311 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.940985    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58df83f1-e36d-45e4-b004-929eb1926155" (UID: "58df83f1-e36d-45e4-b004-929eb1926155"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:58:32.941311 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.941177    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58df83f1-e36d-45e4-b004-929eb1926155-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58df83f1-e36d-45e4-b004-929eb1926155" (UID: "58df83f1-e36d-45e4-b004-929eb1926155"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:58:32.942797 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.942764    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-istio-token" (OuterVolumeSpecName: "istio-token") pod "58df83f1-e36d-45e4-b004-929eb1926155" (UID: "58df83f1-e36d-45e4-b004-929eb1926155"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:58:32.943136 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.943109    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58df83f1-e36d-45e4-b004-929eb1926155" (UID: "58df83f1-e36d-45e4-b004-929eb1926155"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:58:32.943230 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.943179    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-kube-api-access-ftkpd" (OuterVolumeSpecName: "kube-api-access-ftkpd") pod "58df83f1-e36d-45e4-b004-929eb1926155" (UID: "58df83f1-e36d-45e4-b004-929eb1926155"). InnerVolumeSpecName "kube-api-access-ftkpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:58:32.943230 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:32.943219    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58df83f1-e36d-45e4-b004-929eb1926155-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58df83f1-e36d-45e4-b004-929eb1926155" (UID: "58df83f1-e36d-45e4-b004-929eb1926155"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:58:33.012122 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:33.012085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:33.042320 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:33.042280    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58df83f1-e36d-45e4-b004-929eb1926155-istiod-ca-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:58:33.042320 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:33.042318    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-istio-token\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:58:33.042541 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:33.042330    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-workload-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:58:33.042541 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:33.042342    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftkpd\" (UniqueName: \"kubernetes.io/projected/58df83f1-e36d-45e4-b004-929eb1926155-kube-api-access-ftkpd\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:58:33.042541 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:33.042351    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58df83f1-e36d-45e4-b004-929eb1926155-istio-podinfo\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:58:33.042541 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:33.042359    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58df83f1-e36d-45e4-b004-929eb1926155-istio-envoy\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:58:33.213770 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:33.213729    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"]
Sep 08 15:58:33.220236 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:33.220203    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-423c90-openshift-default-5489b5d55b-ltk9h"]
Sep 08 15:58:34.366382 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:34.366350    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58df83f1-e36d-45e4-b004-929eb1926155" path="/var/lib/kubelet/pods/58df83f1-e36d-45e4-b004-929eb1926155/volumes"
Sep 08 15:58:38.886358 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:38.886278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:38.953611 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:38.953561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:39.076025 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:39.075962    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:39.175576 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:39.175536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:39.273712 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:39.273670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:39.694489 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:39.694453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:41.479581 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:41.479544    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:58:56.194137 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:56.194094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:57.003034 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:58:57.002997    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:59:05.634490 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:05.634447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:08.895485 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:08.895445    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:59:12.128337 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:12.128295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:12.240284 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:12.240239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:12.347588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:12.347535    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:18.997158 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:18.997112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:59:22.717570 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:22.717514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:28.207609 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:28.207495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:33.264208 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.264173    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"]
Sep 08 15:59:33.264634 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.264578    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy"
Sep 08 15:59:33.264634 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.264594    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy"
Sep 08 15:59:33.264728 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.264679    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy"
Sep 08 15:59:33.268921 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.268892    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.271180 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.271156    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-3b98e2\"/\"kube-root-ca.crt\""
Sep 08 15:59:33.272017 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.271992    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-3b98e2\"/\"explicit-model-3b98e2-kserve-self-signed-certs\""
Sep 08 15:59:33.272131 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.272000    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-3b98e2\"/\"openshift-service-ca.crt\""
Sep 08 15:59:33.272131 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.272000    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-3b98e2\"/\"default-dockercfg-sqv74\""
Sep 08 15:59:33.277777 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.277748    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"]
Sep 08 15:59:33.285006 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.284975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22kk7\" (UniqueName: \"kubernetes.io/projected/abb2c792-d0bb-4d02-86e9-f25177af7289-kube-api-access-22kk7\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.285266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.285010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-home\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.285266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.285031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-dshm\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.285266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.285057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-tmp-dir\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.285266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.285160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-model-cache\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.285266 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.285244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abb2c792-d0bb-4d02-86e9-f25177af7289-tls-certs\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.290758 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.290731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:33.386484 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.386441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abb2c792-d0bb-4d02-86e9-f25177af7289-tls-certs\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.386698 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.386490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22kk7\" (UniqueName: \"kubernetes.io/projected/abb2c792-d0bb-4d02-86e9-f25177af7289-kube-api-access-22kk7\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.386698 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.386515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-home\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.386698 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.386533    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-dshm\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.386698 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.386550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-tmp-dir\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.386698 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.386600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-model-cache\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.387110 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.387011    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-home\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.387110 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.387086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-model-cache\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.387279 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.387256    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-tmp-dir\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.389042 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.389018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-dshm\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.389140 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.389124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abb2c792-d0bb-4d02-86e9-f25177af7289-tls-certs\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.394083 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.394052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22kk7\" (UniqueName: \"kubernetes.io/projected/abb2c792-d0bb-4d02-86e9-f25177af7289-kube-api-access-22kk7\") pod \"explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") " pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.580889 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.580775    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:33.860591 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:33.860558    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"]
Sep 08 15:59:33.862021 ip-10-0-143-238 kubenswrapper[2581]: W0908 15:59:33.861992    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabb2c792_d0bb_4d02_86e9_f25177af7289.slice/crio-84a22e289b233bb0bd87886772a4e5737733cd2fe3def74ed08fc4955d315bc6 WatchSource:0}: Error finding container 84a22e289b233bb0bd87886772a4e5737733cd2fe3def74ed08fc4955d315bc6: Status 404 returned error can't find the container with id 84a22e289b233bb0bd87886772a4e5737733cd2fe3def74ed08fc4955d315bc6
Sep 08 15:59:34.262325 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:34.262287    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v" event={"ID":"abb2c792-d0bb-4d02-86e9-f25177af7289","Type":"ContainerStarted","Data":"64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99"}
Sep 08 15:59:34.262513 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:34.262339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v" event={"ID":"abb2c792-d0bb-4d02-86e9-f25177af7289","Type":"ContainerStarted","Data":"84a22e289b233bb0bd87886772a4e5737733cd2fe3def74ed08fc4955d315bc6"}
Sep 08 15:59:34.290697 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:34.290642    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v" podStartSLOduration=1.290616988 podStartE2EDuration="1.290616988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:59:34.290148751 +0000 UTC m=+902.412304367" watchObservedRunningTime="2026-09-08 15:59:34.290616988 +0000 UTC m=+902.412772600"
Sep 08 15:59:34.304455 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:34.304423    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:59:34.316869 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:34.316834    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:34.434632 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:34.434597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:34.603086 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:34.602997    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:39.085895 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:39.085858    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"]
Sep 08 15:59:39.099020 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:39.098990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:43.581867 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:43.581802    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:45.030646 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:45.030611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:45.859291 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:45.859260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:49.489499 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:49.489459    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 15:59:49.765380 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:49.765265    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:49.835579 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:49.835537    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:49.934038 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:49.934007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:50.012765 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:50.012728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:50.668082 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:50.668046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:51.988125 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:51.988091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:52.093367 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:52.093317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:52.187835 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:52.187797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:52.304213 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:52.304133    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:53.031566 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:53.031529    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:53.131880 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:53.131847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:54.106256 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.106199    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v" podUID="abb2c792-d0bb-4d02-86e9-f25177af7289" containerName="main" containerID="cri-o://64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99" gracePeriod=45
Sep 08 15:59:54.360448 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.360382    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:54.391264 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.391233    2581 generic.go:356] "Generic (PLEG): container finished" podID="abb2c792-d0bb-4d02-86e9-f25177af7289" containerID="64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99" exitCode=0
Sep 08 15:59:54.391429 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.391274    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"
Sep 08 15:59:54.391429 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.391308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v" event={"ID":"abb2c792-d0bb-4d02-86e9-f25177af7289","Type":"ContainerDied","Data":"64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99"}
Sep 08 15:59:54.391429 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.391350    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v" event={"ID":"abb2c792-d0bb-4d02-86e9-f25177af7289","Type":"ContainerDied","Data":"84a22e289b233bb0bd87886772a4e5737733cd2fe3def74ed08fc4955d315bc6"}
Sep 08 15:59:54.391429 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.391370    2581 scope.go:117] "RemoveContainer" containerID="64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99"
Sep 08 15:59:54.400922 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.400893    2581 scope.go:117] "RemoveContainer" containerID="64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99"
Sep 08 15:59:54.401294 ip-10-0-143-238 kubenswrapper[2581]: E0908 15:59:54.401270    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99\": container with ID starting with 64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99 not found: ID does not exist" containerID="64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99"
Sep 08 15:59:54.401386 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.401304    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99"} err="failed to get container status \"64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99\": rpc error: code = NotFound desc = could not find container \"64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99\": container with ID starting with 64c87a71ce3392008a11e8e3e8ff9bbf94cbe14cef260d93fc3e0ebcc0dd5a99 not found: ID does not exist"
Sep 08 15:59:54.475688 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.475649    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22kk7\" (UniqueName: \"kubernetes.io/projected/abb2c792-d0bb-4d02-86e9-f25177af7289-kube-api-access-22kk7\") pod \"abb2c792-d0bb-4d02-86e9-f25177af7289\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") "
Sep 08 15:59:54.475903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.475709    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-model-cache\") pod \"abb2c792-d0bb-4d02-86e9-f25177af7289\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") "
Sep 08 15:59:54.475903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.475732    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-home\") pod \"abb2c792-d0bb-4d02-86e9-f25177af7289\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") "
Sep 08 15:59:54.475903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.475754    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-dshm\") pod \"abb2c792-d0bb-4d02-86e9-f25177af7289\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") "
Sep 08 15:59:54.475903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.475799    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-tmp-dir\") pod \"abb2c792-d0bb-4d02-86e9-f25177af7289\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") "
Sep 08 15:59:54.475903 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.475889    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abb2c792-d0bb-4d02-86e9-f25177af7289-tls-certs\") pod \"abb2c792-d0bb-4d02-86e9-f25177af7289\" (UID: \"abb2c792-d0bb-4d02-86e9-f25177af7289\") "
Sep 08 15:59:54.476188 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.476063    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-model-cache" (OuterVolumeSpecName: "model-cache") pod "abb2c792-d0bb-4d02-86e9-f25177af7289" (UID: "abb2c792-d0bb-4d02-86e9-f25177af7289"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:59:54.476188 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.476083    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-home" (OuterVolumeSpecName: "home") pod "abb2c792-d0bb-4d02-86e9-f25177af7289" (UID: "abb2c792-d0bb-4d02-86e9-f25177af7289"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:59:54.476288 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.476189    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "abb2c792-d0bb-4d02-86e9-f25177af7289" (UID: "abb2c792-d0bb-4d02-86e9-f25177af7289"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:59:54.476288 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.476258    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-model-cache\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:59:54.476288 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.476277    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-home\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:59:54.478127 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.478092    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abb2c792-d0bb-4d02-86e9-f25177af7289-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "abb2c792-d0bb-4d02-86e9-f25177af7289" (UID: "abb2c792-d0bb-4d02-86e9-f25177af7289"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:59:54.478240 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.478104    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb2c792-d0bb-4d02-86e9-f25177af7289-kube-api-access-22kk7" (OuterVolumeSpecName: "kube-api-access-22kk7") pod "abb2c792-d0bb-4d02-86e9-f25177af7289" (UID: "abb2c792-d0bb-4d02-86e9-f25177af7289"). InnerVolumeSpecName "kube-api-access-22kk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:59:54.478240 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.478105    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-dshm" (OuterVolumeSpecName: "dshm") pod "abb2c792-d0bb-4d02-86e9-f25177af7289" (UID: "abb2c792-d0bb-4d02-86e9-f25177af7289"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:59:54.577036 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.576992    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-dshm\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:59:54.577036 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.577028    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abb2c792-d0bb-4d02-86e9-f25177af7289-tmp-dir\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:59:54.577036 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.577043    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abb2c792-d0bb-4d02-86e9-f25177af7289-tls-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:59:54.577292 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.577055    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22kk7\" (UniqueName: \"kubernetes.io/projected/abb2c792-d0bb-4d02-86e9-f25177af7289-kube-api-access-22kk7\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 15:59:54.639037 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.638954    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:54.712882 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.712797    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"]
Sep 08 15:59:54.717381 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:54.717351    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-3b98e2/explicit-model-3b98e2-kserve-7cf6b48bcf-4jn9v"]
Sep 08 15:59:56.259179 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:56.259124    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:56.360854 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:56.360803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:56.365984 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:56.365953    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb2c792-d0bb-4d02-86e9-f25177af7289" path="/var/lib/kubelet/pods/abb2c792-d0bb-4d02-86e9-f25177af7289/volumes"
Sep 08 15:59:56.601106 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:56.601017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:57.071943 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:57.071906    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:57.510125 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:57.510089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:58.033520 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:58.033485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:59.007925 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:59.007888    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:59.109150 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:59.109116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:59.205588 ip-10-0-143-238 kubenswrapper[2581]: I0908 15:59:59.205556    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:01.332695 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:01.332654    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:01.519371 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:01.519338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:02.025958 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:02.025928    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:03.106744 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:03.106708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:04.781637 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:04.781599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:00:07.946666 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:07.946627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:08.011605 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:08.011568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:08.181269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:08.181233    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:09.056386 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:09.056349    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:09.119408 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:09.119373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:09.347079 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:09.346992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:09.454745 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:09.454704    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:11.676784 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:11.676697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:11.777234 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:11.777193    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:12.856569 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:12.856537    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:13.465639 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:13.465603    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:13.539835 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:13.539781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:14.634394 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:14.634354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:20.683781 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:20.683740    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:00:29.831461 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:29.831420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:31.363681 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:31.363645    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"]
Sep 08 16:00:31.384998 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:31.384957    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:32.431962 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:32.431922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:32.666743 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:32.666712    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:34.736308 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:34.736259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:35.982875 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:35.982829    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:00:36.643506 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:36.643470    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:37.319337 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:37.319288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:37.418615 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:37.418561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:37.775750 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:37.775707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:42.707162 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:42.707124    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:43.263182 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.263145    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"]
Sep 08 16:00:43.263408 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.263380    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z" podUID="8bebe80b-4a7b-4403-9322-75a34a01f055" containerName="maas-api" containerID="cri-o://a5d34bb039318397f1ff818302ec017e9cb39cec498a7738c41cd54375ecac45" gracePeriod=30
Sep 08 16:00:43.294906 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.294860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:43.414273 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.414242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:43.477942 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.477912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:43.538177 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.538093    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:43.691447 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.691414    2581 generic.go:356] "Generic (PLEG): container finished" podID="8bebe80b-4a7b-4403-9322-75a34a01f055" containerID="a5d34bb039318397f1ff818302ec017e9cb39cec498a7738c41cd54375ecac45" exitCode=0
Sep 08 16:00:43.691622 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.691491    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z" event={"ID":"8bebe80b-4a7b-4403-9322-75a34a01f055","Type":"ContainerDied","Data":"a5d34bb039318397f1ff818302ec017e9cb39cec498a7738c41cd54375ecac45"}
Sep 08 16:00:43.724579 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.724554    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 16:00:43.835544 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.835451    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bebe80b-4a7b-4403-9322-75a34a01f055-openshift-service-ca\") pod \"8bebe80b-4a7b-4403-9322-75a34a01f055\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") "
Sep 08 16:00:43.835696 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.835549    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-maas-api-tls\") pod \"8bebe80b-4a7b-4403-9322-75a34a01f055\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") "
Sep 08 16:00:43.835696 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.835585    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-metrics-certs\") pod \"8bebe80b-4a7b-4403-9322-75a34a01f055\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") "
Sep 08 16:00:43.835696 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.835679    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl78c\" (UniqueName: \"kubernetes.io/projected/8bebe80b-4a7b-4403-9322-75a34a01f055-kube-api-access-dl78c\") pod \"8bebe80b-4a7b-4403-9322-75a34a01f055\" (UID: \"8bebe80b-4a7b-4403-9322-75a34a01f055\") "
Sep 08 16:00:43.835948 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.835925    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bebe80b-4a7b-4403-9322-75a34a01f055-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8bebe80b-4a7b-4403-9322-75a34a01f055" (UID: "8bebe80b-4a7b-4403-9322-75a34a01f055"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:00:43.837881 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.837846    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8bebe80b-4a7b-4403-9322-75a34a01f055" (UID: "8bebe80b-4a7b-4403-9322-75a34a01f055"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:00:43.837881 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.837870    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8bebe80b-4a7b-4403-9322-75a34a01f055" (UID: "8bebe80b-4a7b-4403-9322-75a34a01f055"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:00:43.837881 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.837844    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bebe80b-4a7b-4403-9322-75a34a01f055-kube-api-access-dl78c" (OuterVolumeSpecName: "kube-api-access-dl78c") pod "8bebe80b-4a7b-4403-9322-75a34a01f055" (UID: "8bebe80b-4a7b-4403-9322-75a34a01f055"). InnerVolumeSpecName "kube-api-access-dl78c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:43.842652 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.842627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:43.936447 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.936407    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-maas-api-tls\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:43.936447 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.936439    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bebe80b-4a7b-4403-9322-75a34a01f055-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:43.936447 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.936448    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl78c\" (UniqueName: \"kubernetes.io/projected/8bebe80b-4a7b-4403-9322-75a34a01f055-kube-api-access-dl78c\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:43.936447 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:43.936456    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bebe80b-4a7b-4403-9322-75a34a01f055-openshift-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:44.176375 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:44.176339    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:44.276266 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:44.276235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:44.676521 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:44.676482    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:44.698760 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:44.698735    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"
Sep 08 16:00:44.698961 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:44.698735    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z" event={"ID":"8bebe80b-4a7b-4403-9322-75a34a01f055","Type":"ContainerDied","Data":"c500dc4955cc2b592fdb163755d6dcec924aea3edc849ccbbd7f563ab198eedb"}
Sep 08 16:00:44.698961 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:44.698880    2581 scope.go:117] "RemoveContainer" containerID="a5d34bb039318397f1ff818302ec017e9cb39cec498a7738c41cd54375ecac45"
Sep 08 16:00:44.717425 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:44.717390    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"]
Sep 08 16:00:44.720274 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:44.720244    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1190-59b564f5dd-57t7z"]
Sep 08 16:00:46.082746 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.082708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:00:46.366433 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.366350    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bebe80b-4a7b-4403-9322-75a34a01f055" path="/var/lib/kubelet/pods/8bebe80b-4a7b-4403-9322-75a34a01f055/volumes"
Sep 08 16:00:46.383563 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.383526    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl" podUID="4dd41b79-1008-4cd4-be97-f3c5ba71b079" containerName="main" containerID="cri-o://34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00" gracePeriod=45
Sep 08 16:00:46.634654 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.634630    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 16:00:46.712914 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.712873    2581 generic.go:356] "Generic (PLEG): container finished" podID="4dd41b79-1008-4cd4-be97-f3c5ba71b079" containerID="34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00" exitCode=0
Sep 08 16:00:46.713086 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.712928    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"
Sep 08 16:00:46.713086 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.712961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl" event={"ID":"4dd41b79-1008-4cd4-be97-f3c5ba71b079","Type":"ContainerDied","Data":"34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00"}
Sep 08 16:00:46.713086 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.713013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl" event={"ID":"4dd41b79-1008-4cd4-be97-f3c5ba71b079","Type":"ContainerDied","Data":"8257a464d7464d27b21473a6afc608b1e8f38c64db6cdf2d040daa07502b3f69"}
Sep 08 16:00:46.713086 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.713030    2581 scope.go:117] "RemoveContainer" containerID="34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00"
Sep 08 16:00:46.721961 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.721940    2581 scope.go:117] "RemoveContainer" containerID="34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00"
Sep 08 16:00:46.722255 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:00:46.722239    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00\": container with ID starting with 34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00 not found: ID does not exist" containerID="34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00"
Sep 08 16:00:46.722307 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.722264    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00"} err="failed to get container status \"34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00\": rpc error: code = NotFound desc = could not find container \"34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00\": container with ID starting with 34a19be1a33f910aa264e5d7f7ecbae8fefec524385bf81d044f4b61e3e19f00 not found: ID does not exist"
Sep 08 16:00:46.761362 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.761321    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tmp-dir\") pod \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") "
Sep 08 16:00:46.761555 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.761374    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-model-cache\") pod \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") "
Sep 08 16:00:46.761555 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.761418    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9xg6\" (UniqueName: \"kubernetes.io/projected/4dd41b79-1008-4cd4-be97-f3c5ba71b079-kube-api-access-k9xg6\") pod \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") "
Sep 08 16:00:46.761555 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.761463    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-home\") pod \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") "
Sep 08 16:00:46.761555 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.761505    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tls-certs\") pod \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") "
Sep 08 16:00:46.761768 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.761647    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-dshm\") pod \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\" (UID: \"4dd41b79-1008-4cd4-be97-f3c5ba71b079\") "
Sep 08 16:00:46.761768 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.761653    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4dd41b79-1008-4cd4-be97-f3c5ba71b079" (UID: "4dd41b79-1008-4cd4-be97-f3c5ba71b079"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:46.761768 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.761712    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-model-cache" (OuterVolumeSpecName: "model-cache") pod "4dd41b79-1008-4cd4-be97-f3c5ba71b079" (UID: "4dd41b79-1008-4cd4-be97-f3c5ba71b079"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:46.761768 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.761725    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-home" (OuterVolumeSpecName: "home") pod "4dd41b79-1008-4cd4-be97-f3c5ba71b079" (UID: "4dd41b79-1008-4cd4-be97-f3c5ba71b079"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:46.762332 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.762308    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-home\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:46.762332 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.762334    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tmp-dir\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:46.762581 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.762348    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-model-cache\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:46.764433 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.764390    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-dshm" (OuterVolumeSpecName: "dshm") pod "4dd41b79-1008-4cd4-be97-f3c5ba71b079" (UID: "4dd41b79-1008-4cd4-be97-f3c5ba71b079"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:46.764685 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.764660    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4dd41b79-1008-4cd4-be97-f3c5ba71b079" (UID: "4dd41b79-1008-4cd4-be97-f3c5ba71b079"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:00:46.764757 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.764668    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd41b79-1008-4cd4-be97-f3c5ba71b079-kube-api-access-k9xg6" (OuterVolumeSpecName: "kube-api-access-k9xg6") pod "4dd41b79-1008-4cd4-be97-f3c5ba71b079" (UID: "4dd41b79-1008-4cd4-be97-f3c5ba71b079"). InnerVolumeSpecName "kube-api-access-k9xg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:46.863427 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.863390    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9xg6\" (UniqueName: \"kubernetes.io/projected/4dd41b79-1008-4cd4-be97-f3c5ba71b079-kube-api-access-k9xg6\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:46.863427 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.863420    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dd41b79-1008-4cd4-be97-f3c5ba71b079-tls-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:46.863427 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:46.863430    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dd41b79-1008-4cd4-be97-f3c5ba71b079-dshm\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:47.040096 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:47.040056    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"]
Sep 08 16:00:47.046106 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:47.046061    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ef1190/test-model-ef1190-kserve-57499c8b6f-w7zkl"]
Sep 08 16:00:48.365739 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:48.365697    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dd41b79-1008-4cd4-be97-f3c5ba71b079" path="/var/lib/kubelet/pods/4dd41b79-1008-4cd4-be97-f3c5ba71b079/volumes"
Sep 08 16:00:49.597304 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:49.597267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:49.663101 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:49.663066    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:49.819647 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:49.819600    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"]
Sep 08 16:00:49.819929 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:49.819903    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy" containerID="cri-o://24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48" gracePeriod=30
Sep 08 16:00:49.843860 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:49.843806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:50.307018 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:50.306970    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:52.770023 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:52.769986    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:00:52.770425 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:52.770037    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:00:54.338769 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:54.338669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:54.440384 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:54.440336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:54.822062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:54.822032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:55.069991 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.069963    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 16:00:55.242339 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242294    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-certs\") pod \"9d2504fc-94ab-41ac-9a10-328e5362498a\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") "
Sep 08 16:00:55.242339 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242350    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-podinfo\") pod \"9d2504fc-94ab-41ac-9a10-328e5362498a\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") "
Sep 08 16:00:55.242569 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242393    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-envoy\") pod \"9d2504fc-94ab-41ac-9a10-328e5362498a\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") "
Sep 08 16:00:55.242569 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242422    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-credential-socket\") pod \"9d2504fc-94ab-41ac-9a10-328e5362498a\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") "
Sep 08 16:00:55.242569 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242453    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d2504fc-94ab-41ac-9a10-328e5362498a-istiod-ca-cert\") pod \"9d2504fc-94ab-41ac-9a10-328e5362498a\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") "
Sep 08 16:00:55.242569 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242504    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-token\") pod \"9d2504fc-94ab-41ac-9a10-328e5362498a\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") "
Sep 08 16:00:55.242569 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242530    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-socket\") pod \"9d2504fc-94ab-41ac-9a10-328e5362498a\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") "
Sep 08 16:00:55.242569 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242563    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-data\") pod \"9d2504fc-94ab-41ac-9a10-328e5362498a\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") "
Sep 08 16:00:55.242925 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242597    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6nhq\" (UniqueName: \"kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-kube-api-access-r6nhq\") pod \"9d2504fc-94ab-41ac-9a10-328e5362498a\" (UID: \"9d2504fc-94ab-41ac-9a10-328e5362498a\") "
Sep 08 16:00:55.242925 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242599    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d2504fc-94ab-41ac-9a10-328e5362498a" (UID: "9d2504fc-94ab-41ac-9a10-328e5362498a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:55.242925 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242804    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d2504fc-94ab-41ac-9a10-328e5362498a" (UID: "9d2504fc-94ab-41ac-9a10-328e5362498a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:55.242925 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242899    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d2504fc-94ab-41ac-9a10-328e5362498a" (UID: "9d2504fc-94ab-41ac-9a10-328e5362498a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:55.243164 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.242974    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d2504fc-94ab-41ac-9a10-328e5362498a" (UID: "9d2504fc-94ab-41ac-9a10-328e5362498a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:55.243164 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.243016    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:55.243164 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.243034    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-workload-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:55.243164 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.243048    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-credential-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:55.243379 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.243199    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d2504fc-94ab-41ac-9a10-328e5362498a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d2504fc-94ab-41ac-9a10-328e5362498a" (UID: "9d2504fc-94ab-41ac-9a10-328e5362498a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:00:55.244752 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.244726    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d2504fc-94ab-41ac-9a10-328e5362498a" (UID: "9d2504fc-94ab-41ac-9a10-328e5362498a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:00:55.244752 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.244743    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d2504fc-94ab-41ac-9a10-328e5362498a" (UID: "9d2504fc-94ab-41ac-9a10-328e5362498a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:55.244930 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.244814    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-kube-api-access-r6nhq" (OuterVolumeSpecName: "kube-api-access-r6nhq") pod "9d2504fc-94ab-41ac-9a10-328e5362498a" (UID: "9d2504fc-94ab-41ac-9a10-328e5362498a"). InnerVolumeSpecName "kube-api-access-r6nhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:55.244930 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.244916    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d2504fc-94ab-41ac-9a10-328e5362498a" (UID: "9d2504fc-94ab-41ac-9a10-328e5362498a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:55.343949 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.343914    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-podinfo\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:55.343949 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.343943    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-envoy\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:55.343949 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.343953    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d2504fc-94ab-41ac-9a10-328e5362498a-istiod-ca-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:55.343949 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.343960    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-token\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:55.344422 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.343967    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2504fc-94ab-41ac-9a10-328e5362498a-istio-data\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:55.344422 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.343975    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6nhq\" (UniqueName: \"kubernetes.io/projected/9d2504fc-94ab-41ac-9a10-328e5362498a-kube-api-access-r6nhq\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:00:55.398207 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.398166    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:55.472044 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.472012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:55.536874 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.536773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:55.609330 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.609295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:55.684942 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.684884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:55.767175 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.767141    2581 generic.go:356] "Generic (PLEG): container finished" podID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerID="24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48" exitCode=0
Sep 08 16:00:55.767365 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.767193    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"
Sep 08 16:00:55.767365 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.767217    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" event={"ID":"9d2504fc-94ab-41ac-9a10-328e5362498a","Type":"ContainerDied","Data":"24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48"}
Sep 08 16:00:55.767365 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.767269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6" event={"ID":"9d2504fc-94ab-41ac-9a10-328e5362498a","Type":"ContainerDied","Data":"267811190df225a4ed2b3154be470e0e5e57522eaf1757bcde359690fec1eeba"}
Sep 08 16:00:55.767365 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.767301    2581 scope.go:117] "RemoveContainer" containerID="24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48"
Sep 08 16:00:55.777784 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.777764    2581 scope.go:117] "RemoveContainer" containerID="e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0"
Sep 08 16:00:55.787027 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.786978    2581 scope.go:117] "RemoveContainer" containerID="24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48"
Sep 08 16:00:55.787319 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:00:55.787295    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48\": container with ID starting with 24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48 not found: ID does not exist" containerID="24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48"
Sep 08 16:00:55.787373 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.787330    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48"} err="failed to get container status \"24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48\": rpc error: code = NotFound desc = could not find container \"24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48\": container with ID starting with 24107d359a414947f2c3d556a23d850c7578123df989e7d94792f9082382ab48 not found: ID does not exist"
Sep 08 16:00:55.787373 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.787349    2581 scope.go:117] "RemoveContainer" containerID="e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0"
Sep 08 16:00:55.787583 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:00:55.787566    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0\": container with ID starting with e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0 not found: ID does not exist" containerID="e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0"
Sep 08 16:00:55.787632 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.787590    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0"} err="failed to get container status \"e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0\": rpc error: code = NotFound desc = could not find container \"e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0\": container with ID starting with e0d46f2ea3da1f3a8053407f0d0d072f43053b37bdad3a546e2c078976e7f9f0 not found: ID does not exist"
Sep 08 16:00:55.803969 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.803927    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"]
Sep 08 16:00:55.805294 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:55.805254    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1190-openshift-default-c5f74d94b-dwcv6"]
Sep 08 16:00:56.006851 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:56.006795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:56.366273 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:56.366228    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" path="/var/lib/kubelet/pods/9d2504fc-94ab-41ac-9a10-328e5362498a/volumes"
Sep 08 16:00:58.281632 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:00:58.281594    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:01:00.312986 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:00.312951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:00.927092 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:00.927031    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"]
Sep 08 16:01:00.927305 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:00.927286    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d" podUID="bd5c3acb-2f2e-496a-969c-b8c1a948196c" containerName="maas-api" containerID="cri-o://cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31" gracePeriod=30
Sep 08 16:01:00.955599 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:00.955569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:01.033015 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.032972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:01.179188 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.179128    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 16:01:01.198176 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.198122    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-metrics-certs\") pod \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") "
Sep 08 16:01:01.198385 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.198205    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqjqd\" (UniqueName: \"kubernetes.io/projected/bd5c3acb-2f2e-496a-969c-b8c1a948196c-kube-api-access-pqjqd\") pod \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") "
Sep 08 16:01:01.198385 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.198241    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd5c3acb-2f2e-496a-969c-b8c1a948196c-openshift-service-ca\") pod \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") "
Sep 08 16:01:01.198385 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.198272    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-maas-api-tls\") pod \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\" (UID: \"bd5c3acb-2f2e-496a-969c-b8c1a948196c\") "
Sep 08 16:01:01.199453 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.199348    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd5c3acb-2f2e-496a-969c-b8c1a948196c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd5c3acb-2f2e-496a-969c-b8c1a948196c" (UID: "bd5c3acb-2f2e-496a-969c-b8c1a948196c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:01:01.199811 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.199754    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd5c3acb-2f2e-496a-969c-b8c1a948196c-openshift-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:01:01.207308 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.201070    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd5c3acb-2f2e-496a-969c-b8c1a948196c-kube-api-access-pqjqd" (OuterVolumeSpecName: "kube-api-access-pqjqd") pod "bd5c3acb-2f2e-496a-969c-b8c1a948196c" (UID: "bd5c3acb-2f2e-496a-969c-b8c1a948196c"). InnerVolumeSpecName "kube-api-access-pqjqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:01:01.211254 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.211213    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bd5c3acb-2f2e-496a-969c-b8c1a948196c" (UID: "bd5c3acb-2f2e-496a-969c-b8c1a948196c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:01:01.211534 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.211509    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd5c3acb-2f2e-496a-969c-b8c1a948196c" (UID: "bd5c3acb-2f2e-496a-969c-b8c1a948196c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:01:01.300481 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.300446    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqjqd\" (UniqueName: \"kubernetes.io/projected/bd5c3acb-2f2e-496a-969c-b8c1a948196c-kube-api-access-pqjqd\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:01:01.300481 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.300477    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-maas-api-tls\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:01:01.300481 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.300488    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd5c3acb-2f2e-496a-969c-b8c1a948196c-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:01:01.805189 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.805156    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd5c3acb-2f2e-496a-969c-b8c1a948196c" containerID="cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31" exitCode=0
Sep 08 16:01:01.805612 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.805222    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"
Sep 08 16:01:01.805612 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.805242    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d" event={"ID":"bd5c3acb-2f2e-496a-969c-b8c1a948196c","Type":"ContainerDied","Data":"cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31"}
Sep 08 16:01:01.805612 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.805301    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d" event={"ID":"bd5c3acb-2f2e-496a-969c-b8c1a948196c","Type":"ContainerDied","Data":"d7f5ab642c2e5422e9d0cbe7e0f7a6b1f348d7ca8eeb15b72960763b7953100a"}
Sep 08 16:01:01.805612 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.805324    2581 scope.go:117] "RemoveContainer" containerID="cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31"
Sep 08 16:01:01.815681 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.815660    2581 scope.go:117] "RemoveContainer" containerID="cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31"
Sep 08 16:01:01.816048 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:01:01.816025    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31\": container with ID starting with cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31 not found: ID does not exist" containerID="cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31"
Sep 08 16:01:01.816148 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.816054    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31"} err="failed to get container status \"cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31\": rpc error: code = NotFound desc = could not find container \"cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31\": container with ID starting with cbe20e0a6d826941ca0f902c52c36af512081d82e31e020b7665be9590459e31 not found: ID does not exist"
Sep 08 16:01:01.826763 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.826729    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"]
Sep 08 16:01:01.832614 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:01.832585    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c96e2b-7bd7cd6cb6-bpr6d"]
Sep 08 16:01:02.330277 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:02.330234    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:02.365172 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:02.365136    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd5c3acb-2f2e-496a-969c-b8c1a948196c" path="/var/lib/kubelet/pods/bd5c3acb-2f2e-496a-969c-b8c1a948196c/volumes"
Sep 08 16:01:02.507981 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:02.507946    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:04.212737 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:04.212689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:04.374078 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:04.374044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:05.278471 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:05.278434    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:01:07.486601 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:07.486536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:07.588125 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:07.588073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:07.746761 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:07.746664    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:08.286571 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:08.286539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:10.465605 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:10.465554    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:10.521332 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:10.521297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:11.990728 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:11.990682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:12.087205 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:12.087156    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:13.234562 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:13.234490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:13.287592 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:13.287561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:13.761004 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:13.760948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:13.831197 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:13.831146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:15.751579 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:15.751524    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:15.822371 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:15.822329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:15.986114 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:15.986074    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:01:16.686004 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.685952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:16.923177 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923131    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"]
Sep 08 16:01:16.923680 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923657    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy"
Sep 08 16:01:16.923762 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923684    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy"
Sep 08 16:01:16.923762 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923715    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy"
Sep 08 16:01:16.923762 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923724    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy"
Sep 08 16:01:16.923762 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923735    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb2c792-d0bb-4d02-86e9-f25177af7289" containerName="main"
Sep 08 16:01:16.923762 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923744    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb2c792-d0bb-4d02-86e9-f25177af7289" containerName="main"
Sep 08 16:01:16.923762 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923762    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd5c3acb-2f2e-496a-969c-b8c1a948196c" containerName="maas-api"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923770    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd5c3acb-2f2e-496a-969c-b8c1a948196c" containerName="maas-api"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923782    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bebe80b-4a7b-4403-9322-75a34a01f055" containerName="maas-api"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923790    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bebe80b-4a7b-4403-9322-75a34a01f055" containerName="maas-api"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923804    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dd41b79-1008-4cd4-be97-f3c5ba71b079" containerName="main"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923812    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dd41b79-1008-4cd4-be97-f3c5ba71b079" containerName="main"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923841    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923850    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923945    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bebe80b-4a7b-4403-9322-75a34a01f055" containerName="maas-api"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923958    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923967    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd5c3acb-2f2e-496a-969c-b8c1a948196c" containerName="maas-api"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923977    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="58df83f1-e36d-45e4-b004-929eb1926155" containerName="istio-proxy"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923986    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dd41b79-1008-4cd4-be97-f3c5ba71b079" containerName="main"
Sep 08 16:01:16.924077 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.923995    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb2c792-d0bb-4d02-86e9-f25177af7289" containerName="main"
Sep 08 16:01:16.927223 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.927197    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:16.929459 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.929427    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-13d3a5-openshift-default-dockercfg-mrx92\""
Sep 08 16:01:16.938444 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.938387    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"]
Sep 08 16:01:16.951482 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:16.951452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:17.034454 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.034417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istiod-ca-cert\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.034454 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.034457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-data\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.034730 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.034497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-socket\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.034730 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.034598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-envoy\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.034730 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.034645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-token\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.034730 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.034673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-certs\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.034730 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.034691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zngn2\" (UniqueName: \"kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-kube-api-access-zngn2\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.034730 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.034729    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-credential-socket\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.035090 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.034756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-podinfo\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.069196 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.069163    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:17.135679 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.135643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-socket\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.135679 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.135685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-envoy\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.135941 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.135809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-token\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.135941 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.135879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-certs\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.135941 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.135908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zngn2\" (UniqueName: \"kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-kube-api-access-zngn2\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.136071 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.135958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-credential-socket\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.136071 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.136005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-podinfo\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.136179 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.136075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istiod-ca-cert\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.136179 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.136101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-socket\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.136179 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.136108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-data\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.136346 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.136331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-certs\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.136437 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.136402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-credential-socket\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.136437 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.136416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-data\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.136752 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.136736    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istiod-ca-cert\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.138013 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.137992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-envoy\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.138337 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.138317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-podinfo\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.143196 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.143171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-token\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.143372 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.143297    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zngn2\" (UniqueName: \"kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-kube-api-access-zngn2\") pod \"e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") " pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.239489 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.239393    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:17.521585 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.521556    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"]
Sep 08 16:01:17.523733 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:01:17.523704    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec1e460_2dd2_4688_8610_9169e2ce7f0c.slice/crio-e5c5125bc49647fd9593d5956bfbd7fd399c4491270fc69622ade642e8990cea WatchSource:0}: Error finding container e5c5125bc49647fd9593d5956bfbd7fd399c4491270fc69622ade642e8990cea: Status 404 returned error can't find the container with id e5c5125bc49647fd9593d5956bfbd7fd399c4491270fc69622ade642e8990cea
Sep 08 16:01:17.526113 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.526073    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:17.526209 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.526161    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:17.526251 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.526205    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:17.898594 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.898499    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" event={"ID":"9ec1e460-2dd2-4688-8610-9169e2ce7f0c","Type":"ContainerStarted","Data":"3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663"}
Sep 08 16:01:17.898594 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.898555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" event={"ID":"9ec1e460-2dd2-4688-8610-9169e2ce7f0c","Type":"ContainerStarted","Data":"e5c5125bc49647fd9593d5956bfbd7fd399c4491270fc69622ade642e8990cea"}
Sep 08 16:01:17.922270 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:17.922213    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" podStartSLOduration=1.922191664 podStartE2EDuration="1.922191664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:01:17.91999674 +0000 UTC m=+1006.042152354" watchObservedRunningTime="2026-09-08 16:01:17.922191664 +0000 UTC m=+1006.044347278"
Sep 08 16:01:18.240540 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:18.240491    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:18.245724 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:18.245696    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:18.904474 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:18.904436    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:18.905564 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:18.905544    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:19.800110 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:19.800069    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:19.898992 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:19.898959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:20.980127 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:20.980087    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"]
Sep 08 16:01:20.980600 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:20.980509    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d2504fc-94ab-41ac-9a10-328e5362498a" containerName="istio-proxy"
Sep 08 16:01:20.983900 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:20.983876    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:20.986129 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:20.986099    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-13d3a5-serving-cert\""
Sep 08 16:01:20.986293 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:20.986147    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vmx7t\""
Sep 08 16:01:20.994043 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:20.994013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"]
Sep 08 16:01:21.016993 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.016957    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:21.072362 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.072320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.072552 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.072373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.072552 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.072434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l57w2\" (UniqueName: \"kubernetes.io/projected/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-kube-api-access-l57w2\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.072552 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.072515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.119046 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.119009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:21.173920 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.173880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.174102 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.173926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.174102 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.173947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l57w2\" (UniqueName: \"kubernetes.io/projected/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-kube-api-access-l57w2\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.174102 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.173988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.174671 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.174651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.176434 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.176414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.176534 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.176460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.182334 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.182306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l57w2\" (UniqueName: \"kubernetes.io/projected/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-kube-api-access-l57w2\") pod \"maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.217567 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.217522    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:21.297749 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.297655    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:21.580989 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.580899    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"]
Sep 08 16:01:21.585428 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:01:21.585385    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f946ddb_3d03_42b0_bdbc_3244d06bb4ff.slice/crio-a1c3177d27c72c05ebea3649a642c3c0ad4fece1dcf6d08e9f31270de259c980 WatchSource:0}: Error finding container a1c3177d27c72c05ebea3649a642c3c0ad4fece1dcf6d08e9f31270de259c980: Status 404 returned error can't find the container with id a1c3177d27c72c05ebea3649a642c3c0ad4fece1dcf6d08e9f31270de259c980
Sep 08 16:01:21.587099 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.587077    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:01:21.614017 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.613981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:21.805935 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.805904    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:21.923437 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:21.923390    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc" event={"ID":"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff","Type":"ContainerStarted","Data":"a1c3177d27c72c05ebea3649a642c3c0ad4fece1dcf6d08e9f31270de259c980"}
Sep 08 16:01:22.930412 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:22.930373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc" event={"ID":"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff","Type":"ContainerStarted","Data":"b233310573d7955b51ca849eda6aecf6a219f33b384679cef0da67737a352058"}
Sep 08 16:01:22.930799 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:22.930436    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:22.947583 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:22.947529    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc" podStartSLOduration=2.2302932540000002 podStartE2EDuration="2.947509943s" totalImagesPullingTime="717.216689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:01:22.945867369 +0000 UTC m=+1011.068022974" watchObservedRunningTime="2026-09-08 16:01:22.947509943 +0000 UTC m=+1011.069665558"
Sep 08 16:01:25.384649 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:25.384606    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:01:28.941336 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:28.941304    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:01:34.945999 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:34.945950    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:01:34.946368 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:34.946043    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:01:35.095518 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:35.095481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:36.961117 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:36.961074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:37.014297 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.014261    2581 generic.go:356] "Generic (PLEG): container finished" podID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerID="3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663" exitCode=0
Sep 08 16:01:37.014482 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.014336    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" event={"ID":"9ec1e460-2dd2-4688-8610-9169e2ce7f0c","Type":"ContainerDied","Data":"3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663"}
Sep 08 16:01:37.014721 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.014708    2581 scope.go:117] "RemoveContainer" containerID="3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663"
Sep 08 16:01:37.015755 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.015724    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:37.015843 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.015812    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:37.015888 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.015872    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:37.317090 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.316999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:37.601179 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.601082    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"]
Sep 08 16:01:37.604505 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.604478    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.606950 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.606925    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-a09aa5-openshift-default-dockercfg-lzb2j\""
Sep 08 16:01:37.624208 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.624169    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"]
Sep 08 16:01:37.637402 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.637362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:37.719457 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.719397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-envoy\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.719661 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.719461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b90e93b0-f3c2-4437-b437-c99448a86889-istio-podinfo\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.719661 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.719593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-istio-token\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.719661 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.719640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6nkt\" (UniqueName: \"kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-kube-api-access-s6nkt\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.719845 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.719718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-data\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.719845 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.719786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-socket\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.719933 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.719846    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-certs\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.719933 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.719901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b90e93b0-f3c2-4437-b437-c99448a86889-istiod-ca-cert\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.720075 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.719970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-credential-socket\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.820774 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.820732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-credential-socket\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.821121 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.821097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-envoy\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.821255 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.821229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-credential-socket\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.821327 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.821306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b90e93b0-f3c2-4437-b437-c99448a86889-istio-podinfo\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.821386 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.821359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-istio-token\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.821438 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.821396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6nkt\" (UniqueName: \"kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-kube-api-access-s6nkt\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.821532 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.821516    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-data\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.821663 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.821636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-socket\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.821843 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.821671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-certs\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.821843 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.821724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b90e93b0-f3c2-4437-b437-c99448a86889-istiod-ca-cert\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.821975 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.821814    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-data\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.822071 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.822044    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-socket\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.822137 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.822095    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-certs\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.822464 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.822435    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b90e93b0-f3c2-4437-b437-c99448a86889-istiod-ca-cert\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.823877 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.823856    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-envoy\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.823965 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.823935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b90e93b0-f3c2-4437-b437-c99448a86889-istio-podinfo\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.829662 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.829628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6nkt\" (UniqueName: \"kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-kube-api-access-s6nkt\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.829662 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.829641    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-istio-token\") pod \"e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") " pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:37.916444 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:37.916046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:38.041895 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:38.041540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:38.047117 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:38.047079    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" event={"ID":"9ec1e460-2dd2-4688-8610-9169e2ce7f0c","Type":"ContainerStarted","Data":"712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31"}
Sep 08 16:01:38.208111 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:38.208075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"]
Sep 08 16:01:38.209849 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:01:38.209804    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90e93b0_f3c2_4437_b437_c99448a86889.slice/crio-97e7ad0753e2c69f423d03025dc74c76ea09a4392b0b3f64873e98bb566401df WatchSource:0}: Error finding container 97e7ad0753e2c69f423d03025dc74c76ea09a4392b0b3f64873e98bb566401df: Status 404 returned error can't find the container with id 97e7ad0753e2c69f423d03025dc74c76ea09a4392b0b3f64873e98bb566401df
Sep 08 16:01:38.212397 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:38.212357    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:38.212611 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:38.212588    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:38.212735 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:38.212719    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:38.243914 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:38.243785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:38.243914 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:38.243868    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:01:38.244176 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:38.243933    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:01:39.054726 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:39.054682    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" event={"ID":"b90e93b0-f3c2-4437-b437-c99448a86889","Type":"ContainerStarted","Data":"719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7"}
Sep 08 16:01:39.055272 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:39.054759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" event={"ID":"b90e93b0-f3c2-4437-b437-c99448a86889","Type":"ContainerStarted","Data":"97e7ad0753e2c69f423d03025dc74c76ea09a4392b0b3f64873e98bb566401df"}
Sep 08 16:01:39.077213 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:39.077154    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" podStartSLOduration=2.077134672 podStartE2EDuration="2.077134672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:01:39.075716167 +0000 UTC m=+1027.197871781" watchObservedRunningTime="2026-09-08 16:01:39.077134672 +0000 UTC m=+1027.199290286"
Sep 08 16:01:39.240423 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:39.240386    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:01:39.240580 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:39.240447    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:01:39.917357 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:39.917293    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:39.928655 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:39.928612    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:40.061755 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:40.061725    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:40.062925 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:40.062898    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:01:40.240501 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:40.240404    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:01:40.240501 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:40.240471    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:01:40.971405 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:40.971363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:41.069716 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:41.069651    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:41.240471 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:41.240373    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:01:41.240471 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:41.240440    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:01:41.831102 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:41.830978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:41.974439 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:41.974404    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:42.240156 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.240121    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:01:42.240551 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.240176    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:01:42.789177 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.789138    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"]
Sep 08 16:01:42.792319 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.792300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:42.794642 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.794623    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-a09aa5-serving-cert\""
Sep 08 16:01:42.803810 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.803784    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"]
Sep 08 16:01:42.826661 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.826622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:42.918134 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.918073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:42.979796 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.979757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmstt\" (UniqueName: \"kubernetes.io/projected/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-kube-api-access-vmstt\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:42.979994 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.979840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:42.979994 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.979883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:42.979994 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:42.979953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:43.015479 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.015440    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:43.080887 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.080764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:43.080887 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.080816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmstt\" (UniqueName: \"kubernetes.io/projected/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-kube-api-access-vmstt\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:43.080887 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.080888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:43.081184 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.080910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:43.081566 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.081530    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:43.083348 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.083323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:43.083448 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.083356    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:43.089009 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.088984    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmstt\" (UniqueName: \"kubernetes.io/projected/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-kube-api-access-vmstt\") pod \"maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:43.105000 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.104967    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:43.242437 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.242074    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:01:43.242437 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.242135    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 08 16:01:43.273445 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.273415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:43.381033 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.380962    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:43.400631 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.400594    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"]
Sep 08 16:01:43.401907 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:01:43.401879    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf185e89_aa2f_45b8_bdcd_3cc74c7de3bd.slice/crio-c2532eeb209150d4665f9d754ce37c3cd03c3beb520d8af5be1b03bded197adc WatchSource:0}: Error finding container c2532eeb209150d4665f9d754ce37c3cd03c3beb520d8af5be1b03bded197adc: Status 404 returned error can't find the container with id c2532eeb209150d4665f9d754ce37c3cd03c3beb520d8af5be1b03bded197adc
Sep 08 16:01:43.709681 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:43.709646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:44.086559 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.086458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn" event={"ID":"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd","Type":"ContainerStarted","Data":"5e1a59ebd0c6f52ceda9650ef1c1ce8829ff1c6d057ee9dc540f0c60d377758a"}
Sep 08 16:01:44.086559 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.086516    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn" event={"ID":"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd","Type":"ContainerStarted","Data":"c2532eeb209150d4665f9d754ce37c3cd03c3beb520d8af5be1b03bded197adc"}
Sep 08 16:01:44.086773 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.086676    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:44.104795 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.104739    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn" podStartSLOduration=1.7086843649999999 podStartE2EDuration="2.104721261s" totalImagesPullingTime="396.036896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:01:44.103005898 +0000 UTC m=+1032.225161512" watchObservedRunningTime="2026-09-08 16:01:44.104721261 +0000 UTC m=+1032.226876876"
Sep 08 16:01:44.133118 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.133078    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:44.234647 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.234589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:44.244204 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.244174    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:44.244681 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.244546    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:44.245430 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.245407    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:01:44.352437 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.352351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:44.757747 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:44.757716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:45.086865 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:45.086746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:45.387630 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:45.387533    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:45.485871 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:45.485816    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:47.879617 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:47.879577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:01:48.069314 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:48.069281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:48.168787 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:48.168756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:49.292894 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.292850    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"]
Sep 08 16:01:49.296168 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.296141    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.298404 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.298378    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-e69292-serving-cert\""
Sep 08 16:01:49.308095 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.308062    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"]
Sep 08 16:01:49.328223 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.328186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:49.335537 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.335505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.335667 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.335549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.335667 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.335570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.335667 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.335626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxs5v\" (UniqueName: \"kubernetes.io/projected/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-kube-api-access-dxs5v\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.428350 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.428315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:49.436616 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.436573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.436749 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.436686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.436749 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.436743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.436998 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:01:49.436778    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-serving-cert: secret "maas-api-e2e-shared-b-w2-e69292-serving-cert" not found
Sep 08 16:01:49.436998 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.436783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxs5v\" (UniqueName: \"kubernetes.io/projected/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-kube-api-access-dxs5v\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.436998 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:01:49.436893    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-maas-api-tls podName:d50250c2-a715-4668-8c5e-8c0a61aa8f8d nodeName:}" failed. No retries permitted until 2026-09-08 16:01:49.936868797 +0000 UTC m=+1038.059024403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-maas-api-tls") pod "maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd" (UID: "d50250c2-a715-4668-8c5e-8c0a61aa8f8d") : secret "maas-api-e2e-shared-b-w2-e69292-serving-cert" not found
Sep 08 16:01:49.437428 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.437407    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.439343 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.439322    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.447281 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.447250    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxs5v\" (UniqueName: \"kubernetes.io/projected/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-kube-api-access-dxs5v\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.601076 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.600983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:49.922472 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.922429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:49.943387 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.943343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:49.946084 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:49.946055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:50.017408 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:50.017368    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:50.096871 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:50.096809    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:01:50.210411 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:50.210319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:50.508072 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:50.508045    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"]
Sep 08 16:01:50.510223 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:01:50.510199    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd50250c2_a715_4668_8c5e_8c0a61aa8f8d.slice/crio-c35e5db85fd799a41022130d10fb4924415e965b2900d19b85d93a7e2f85c56b WatchSource:0}: Error finding container c35e5db85fd799a41022130d10fb4924415e965b2900d19b85d93a7e2f85c56b: Status 404 returned error can't find the container with id c35e5db85fd799a41022130d10fb4924415e965b2900d19b85d93a7e2f85c56b
Sep 08 16:01:51.145504 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:51.145472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd" event={"ID":"d50250c2-a715-4668-8c5e-8c0a61aa8f8d","Type":"ContainerStarted","Data":"ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e"}
Sep 08 16:01:51.145697 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:51.145522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd" event={"ID":"d50250c2-a715-4668-8c5e-8c0a61aa8f8d","Type":"ContainerStarted","Data":"c35e5db85fd799a41022130d10fb4924415e965b2900d19b85d93a7e2f85c56b"}
Sep 08 16:01:51.145697 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:51.145615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:51.162613 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:51.162564    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd" podStartSLOduration=1.697672983 podStartE2EDuration="2.162549489s" totalImagesPullingTime="464.876506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:01:51.161663543 +0000 UTC m=+1039.283819164" watchObservedRunningTime="2026-09-08 16:01:51.162549489 +0000 UTC m=+1039.284705098"
Sep 08 16:01:57.157996 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:57.157961    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:01:59.197439 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:59.197406    2581 generic.go:356] "Generic (PLEG): container finished" podID="b90e93b0-f3c2-4437-b437-c99448a86889" containerID="719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7" exitCode=0
Sep 08 16:01:59.197884 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:59.197466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" event={"ID":"b90e93b0-f3c2-4437-b437-c99448a86889","Type":"ContainerDied","Data":"719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7"}
Sep 08 16:01:59.197884 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:59.197876    2581 scope.go:117] "RemoveContainer" containerID="719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7"
Sep 08 16:01:59.199084 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:59.199048    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:59.199150 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:59.199130    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:59.199186 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:59.199160    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:01:59.681979 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:01:59.681934    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:02:00.205479 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:00.205446    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" event={"ID":"b90e93b0-f3c2-4437-b437-c99448a86889","Type":"ContainerStarted","Data":"2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085"}
Sep 08 16:02:00.917679 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:00.917641    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:02:00.918433 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:00.918017    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 08 16:02:00.918433 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:00.918159    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 08 16:02:01.917363 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:01.917314    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 08 16:02:01.917900 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:01.917387    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 08 16:02:02.917471 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:02.917432    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 08 16:02:02.918146 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:02.918106    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 08 16:02:03.824942 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:03.824901    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:03.917106 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:03.917062    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 08 16:02:03.917408 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:03.917377    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 08 16:02:04.917917 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:04.917870    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 08 16:02:04.918429 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:04.917942    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 08 16:02:05.921935 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:05.921897    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:02:05.922332 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:05.922156    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:02:05.923016 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:05.922997    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:02:05.995613 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:05.995574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:10.294379 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:10.294343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:11.797350 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:11.797262    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:13.048688 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:13.048652    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:15.788027 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:15.787981    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:02:21.627299 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:21.627258    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7947-139872176495472"]
Sep 08 16:02:21.629763 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:21.629743    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:21.631815 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:21.631791    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5nm68\""
Sep 08 16:02:21.637775 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:21.637749    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7947-139872176495472"]
Sep 08 16:02:21.755227 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:21.755193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7qfs\" (UniqueName: \"kubernetes.io/projected/6a52678f-631c-4d1d-bec0-22717a24100b-kube-api-access-k7qfs\") pod \"test-curl-7947-139872176495472\" (UID: \"6a52678f-631c-4d1d-bec0-22717a24100b\") " pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:21.856288 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:21.856239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7qfs\" (UniqueName: \"kubernetes.io/projected/6a52678f-631c-4d1d-bec0-22717a24100b-kube-api-access-k7qfs\") pod \"test-curl-7947-139872176495472\" (UID: \"6a52678f-631c-4d1d-bec0-22717a24100b\") " pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:21.864165 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:21.864127    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7qfs\" (UniqueName: \"kubernetes.io/projected/6a52678f-631c-4d1d-bec0-22717a24100b-kube-api-access-k7qfs\") pod \"test-curl-7947-139872176495472\" (UID: \"6a52678f-631c-4d1d-bec0-22717a24100b\") " pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:21.940481 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:21.940444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:22.212407 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:22.212376    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7947-139872176495472"]
Sep 08 16:02:22.213868 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:02:22.213817    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a52678f_631c_4d1d_bec0_22717a24100b.slice/crio-e8dffdf7c54da65101801ff42072d0a988bcf4d0e520b45b3f7e57e060b01a1f WatchSource:0}: Error finding container e8dffdf7c54da65101801ff42072d0a988bcf4d0e520b45b3f7e57e060b01a1f: Status 404 returned error can't find the container with id e8dffdf7c54da65101801ff42072d0a988bcf4d0e520b45b3f7e57e060b01a1f
Sep 08 16:02:22.358331 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:22.358293    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7947-139872176495472" event={"ID":"6a52678f-631c-4d1d-bec0-22717a24100b","Type":"ContainerStarted","Data":"e8dffdf7c54da65101801ff42072d0a988bcf4d0e520b45b3f7e57e060b01a1f"}
Sep 08 16:02:23.365977 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:23.365939    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a52678f-631c-4d1d-bec0-22717a24100b" containerID="41c6d6f65f4e5501df2a77dcf895b882fc3c1e01a2dcb8f3f2619dff4ca8e146" exitCode=0
Sep 08 16:02:23.366386 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:23.366022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7947-139872176495472" event={"ID":"6a52678f-631c-4d1d-bec0-22717a24100b","Type":"ContainerDied","Data":"41c6d6f65f4e5501df2a77dcf895b882fc3c1e01a2dcb8f3f2619dff4ca8e146"}
Sep 08 16:02:24.509151 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.509119    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:24.528908 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.528855    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7947-139872176495472_6a52678f-631c-4d1d-bec0-22717a24100b/test-curl-7947-139872176495472/0.log"
Sep 08 16:02:24.549209 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.549165    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7947-139872176495472"]
Sep 08 16:02:24.552719 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.552685    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7947-139872176495472"]
Sep 08 16:02:24.667801 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.667763    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7947-139872176495472"]
Sep 08 16:02:24.668191 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.668178    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a52678f-631c-4d1d-bec0-22717a24100b" containerName="test-curl-7947-139872176495472"
Sep 08 16:02:24.668234 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.668193    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a52678f-631c-4d1d-bec0-22717a24100b" containerName="test-curl-7947-139872176495472"
Sep 08 16:02:24.668274 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.668258    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a52678f-631c-4d1d-bec0-22717a24100b" containerName="test-curl-7947-139872176495472"
Sep 08 16:02:24.670617 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.670599    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:24.676262 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.676231    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7947-139872176495472"]
Sep 08 16:02:24.683175 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.683144    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7qfs\" (UniqueName: \"kubernetes.io/projected/6a52678f-631c-4d1d-bec0-22717a24100b-kube-api-access-k7qfs\") pod \"6a52678f-631c-4d1d-bec0-22717a24100b\" (UID: \"6a52678f-631c-4d1d-bec0-22717a24100b\") "
Sep 08 16:02:24.685362 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.685332    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a52678f-631c-4d1d-bec0-22717a24100b-kube-api-access-k7qfs" (OuterVolumeSpecName: "kube-api-access-k7qfs") pod "6a52678f-631c-4d1d-bec0-22717a24100b" (UID: "6a52678f-631c-4d1d-bec0-22717a24100b"). InnerVolumeSpecName "kube-api-access-k7qfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:02:24.784406 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.784366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wfnv\" (UniqueName: \"kubernetes.io/projected/fcf83d2d-69a7-4288-aedb-6074dfc546bb-kube-api-access-5wfnv\") pod \"test-curl-7947-139872176495472\" (UID: \"fcf83d2d-69a7-4288-aedb-6074dfc546bb\") " pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:24.784594 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.784420    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7qfs\" (UniqueName: \"kubernetes.io/projected/6a52678f-631c-4d1d-bec0-22717a24100b-kube-api-access-k7qfs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:02:24.885064 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.885014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wfnv\" (UniqueName: \"kubernetes.io/projected/fcf83d2d-69a7-4288-aedb-6074dfc546bb-kube-api-access-5wfnv\") pod \"test-curl-7947-139872176495472\" (UID: \"fcf83d2d-69a7-4288-aedb-6074dfc546bb\") " pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:24.892729 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.892693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wfnv\" (UniqueName: \"kubernetes.io/projected/fcf83d2d-69a7-4288-aedb-6074dfc546bb-kube-api-access-5wfnv\") pod \"test-curl-7947-139872176495472\" (UID: \"fcf83d2d-69a7-4288-aedb-6074dfc546bb\") " pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:24.982124 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:24.982028    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:25.252776 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:25.252743    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7947-139872176495472"]
Sep 08 16:02:25.254605 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:02:25.254577    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcf83d2d_69a7_4288_aedb_6074dfc546bb.slice/crio-27826467a8bb38721e619c12b258ffb12b40fd1269b46ffa6c961c87693d7eb6 WatchSource:0}: Error finding container 27826467a8bb38721e619c12b258ffb12b40fd1269b46ffa6c961c87693d7eb6: Status 404 returned error can't find the container with id 27826467a8bb38721e619c12b258ffb12b40fd1269b46ffa6c961c87693d7eb6
Sep 08 16:02:25.380134 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:25.380105    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:25.380320 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:25.380111    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8dffdf7c54da65101801ff42072d0a988bcf4d0e520b45b3f7e57e060b01a1f"
Sep 08 16:02:25.381507 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:25.381477    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7947-139872176495472" event={"ID":"fcf83d2d-69a7-4288-aedb-6074dfc546bb","Type":"ContainerStarted","Data":"27826467a8bb38721e619c12b258ffb12b40fd1269b46ffa6c961c87693d7eb6"}
Sep 08 16:02:25.391531 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:25.391492    2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7947-139872176495472" oldPodUID="6a52678f-631c-4d1d-bec0-22717a24100b" podUID="fcf83d2d-69a7-4288-aedb-6074dfc546bb"
Sep 08 16:02:26.365766 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:26.365727    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a52678f-631c-4d1d-bec0-22717a24100b" path="/var/lib/kubelet/pods/6a52678f-631c-4d1d-bec0-22717a24100b/volumes"
Sep 08 16:02:26.388414 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:26.388380    2581 generic.go:356] "Generic (PLEG): container finished" podID="fcf83d2d-69a7-4288-aedb-6074dfc546bb" containerID="b46355a8adcdb7bbff954ee7f3a1aec5be4815d68c416c35144a393c0c3b50f2" exitCode=0
Sep 08 16:02:26.388579 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:26.388465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7947-139872176495472" event={"ID":"fcf83d2d-69a7-4288-aedb-6074dfc546bb","Type":"ContainerDied","Data":"b46355a8adcdb7bbff954ee7f3a1aec5be4815d68c416c35144a393c0c3b50f2"}
Sep 08 16:02:27.533657 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:27.533628    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:27.553206 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:27.553167    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7947-139872176495472_fcf83d2d-69a7-4288-aedb-6074dfc546bb/test-curl-7947-139872176495472/0.log"
Sep 08 16:02:27.575315 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:27.575271    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7947-139872176495472"]
Sep 08 16:02:27.581686 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:27.581650    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7947-139872176495472"]
Sep 08 16:02:27.714719 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:27.714681    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wfnv\" (UniqueName: \"kubernetes.io/projected/fcf83d2d-69a7-4288-aedb-6074dfc546bb-kube-api-access-5wfnv\") pod \"fcf83d2d-69a7-4288-aedb-6074dfc546bb\" (UID: \"fcf83d2d-69a7-4288-aedb-6074dfc546bb\") "
Sep 08 16:02:27.716734 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:27.716700    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf83d2d-69a7-4288-aedb-6074dfc546bb-kube-api-access-5wfnv" (OuterVolumeSpecName: "kube-api-access-5wfnv") pod "fcf83d2d-69a7-4288-aedb-6074dfc546bb" (UID: "fcf83d2d-69a7-4288-aedb-6074dfc546bb"). InnerVolumeSpecName "kube-api-access-5wfnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:02:27.815735 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:27.815698    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wfnv\" (UniqueName: \"kubernetes.io/projected/fcf83d2d-69a7-4288-aedb-6074dfc546bb-kube-api-access-5wfnv\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:02:28.191634 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.191597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:28.366993 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.366959    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcf83d2d-69a7-4288-aedb-6074dfc546bb" path="/var/lib/kubelet/pods/fcf83d2d-69a7-4288-aedb-6074dfc546bb/volumes"
Sep 08 16:02:28.403855 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.403811    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7947-139872176495472"
Sep 08 16:02:28.404040 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.403810    2581 scope.go:117] "RemoveContainer" containerID="b46355a8adcdb7bbff954ee7f3a1aec5be4815d68c416c35144a393c0c3b50f2"
Sep 08 16:02:28.550841 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.550735    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"]
Sep 08 16:02:28.551234 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.551158    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcf83d2d-69a7-4288-aedb-6074dfc546bb" containerName="test-curl-7947-139872176495472"
Sep 08 16:02:28.551234 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.551172    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcf83d2d-69a7-4288-aedb-6074dfc546bb" containerName="test-curl-7947-139872176495472"
Sep 08 16:02:28.551378 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.551246    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcf83d2d-69a7-4288-aedb-6074dfc546bb" containerName="test-curl-7947-139872176495472"
Sep 08 16:02:28.554374 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.554355    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.557864 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.557816    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-510a51a5-openshift-default-dockercfg-7254z\""
Sep 08 16:02:28.590085 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.590052    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"]
Sep 08 16:02:28.643701 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.643658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:28.723932 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.723894    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-socket\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.723932 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.723944    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-certs\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.724161 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.723969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-data\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.724161 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.723984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkqqc\" (UniqueName: \"kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-kube-api-access-zkqqc\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.724161 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.724001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-credential-socket\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.724161 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.724018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-podinfo\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.724161 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.724042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istiod-ca-cert\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.724161 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.724074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-token\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.724161 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.724114    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-envoy\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.737961 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.737930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:28.825509 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-socket\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.825509 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-certs\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.825710 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-data\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.825710 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkqqc\" (UniqueName: \"kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-kube-api-access-zkqqc\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.825710 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-credential-socket\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.825710 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-podinfo\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.825976 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istiod-ca-cert\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.825976 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-token\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.825976 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-envoy\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.825976 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825865    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-certs\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.825976 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.825903    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-socket\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.826169 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.826008    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-data\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.826206 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.826191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-credential-socket\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.826474 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.826450    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istiod-ca-cert\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.828205 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.828182    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-envoy\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.828486 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.828464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-podinfo\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.833098 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.833073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-token\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.833215 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.833194    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkqqc\" (UniqueName: \"kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-kube-api-access-zkqqc\") pod \"e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") " pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:28.865157 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:28.865116    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:29.141634 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.141599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"]
Sep 08 16:02:29.143081 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:02:29.143059    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec19b90_3597_4646_a7ed_edb59ec4a8a7.slice/crio-0f2e83977a0ce5834238941de1675982950de1de3672b7557e709181afbe4d4b WatchSource:0}: Error finding container 0f2e83977a0ce5834238941de1675982950de1de3672b7557e709181afbe4d4b: Status 404 returned error can't find the container with id 0f2e83977a0ce5834238941de1675982950de1de3672b7557e709181afbe4d4b
Sep 08 16:02:29.145878 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.145815    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:02:29.145953 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.145911    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:02:29.145953 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.145942    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:02:29.372114 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.372050    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:29.413885 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.413792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" event={"ID":"5ec19b90-3597-4646-a7ed-edb59ec4a8a7","Type":"ContainerStarted","Data":"7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8"}
Sep 08 16:02:29.413885 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.413880    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" event={"ID":"5ec19b90-3597-4646-a7ed-edb59ec4a8a7","Type":"ContainerStarted","Data":"0f2e83977a0ce5834238941de1675982950de1de3672b7557e709181afbe4d4b"}
Sep 08 16:02:29.426767 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.426716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:29.433734 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.433660    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" podStartSLOduration=1.433642873 podStartE2EDuration="1.433642873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:02:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:02:29.432467441 +0000 UTC m=+1077.554623067" watchObservedRunningTime="2026-09-08 16:02:29.433642873 +0000 UTC m=+1077.555798489"
Sep 08 16:02:29.865530 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.865445    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:29.877157 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.877113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:29.932236 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:29.932201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:30.871582 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:30.871550    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:31.322105 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:31.322069    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:31.415781 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:31.415746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:31.433090 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:31.433060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:31.434230 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:31.434207    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:32.451753 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:32.451720    2581 scope.go:117] "RemoveContainer" containerID="4edbe4b10824aa856b510b56e77755a1239c11d005c936f897f20d9617ab2341"
Sep 08 16:02:32.612772 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:32.612735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:32.713197 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:32.713116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:32.813188 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:32.813157    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:33.106877 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:33.106756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:33.272712 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:33.272678    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:38.079474 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:38.079434    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:02:47.474992 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:47.474947    2581 patch_prober.go:28] interesting pod/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:02:47.475453 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:47.475028    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:02:49.555893 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:49.555857    2581 generic.go:356] "Generic (PLEG): container finished" podID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerID="7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8" exitCode=0
Sep 08 16:02:49.556320 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:49.555915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" event={"ID":"5ec19b90-3597-4646-a7ed-edb59ec4a8a7","Type":"ContainerDied","Data":"7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8"}
Sep 08 16:02:49.556320 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:49.556308    2581 scope.go:117] "RemoveContainer" containerID="7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8"
Sep 08 16:02:49.557465 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:49.557435    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:02:49.557532 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:49.557506    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:02:49.557569 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:49.557537    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:02:50.563989 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.563955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" event={"ID":"5ec19b90-3597-4646-a7ed-edb59ec4a8a7","Type":"ContainerStarted","Data":"76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a"}
Sep 08 16:02:50.788615 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.788580    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"]
Sep 08 16:02:50.791474 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.791453    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.793806 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.793773    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-a09aa5\"/\"openshift-service-ca.crt\""
Sep 08 16:02:50.793806 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.793781    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-a09aa5\"/\"default-dockercfg-shzhl\""
Sep 08 16:02:50.794049 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.793857    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-a09aa5\"/\"auth-test-model-a09aa5-kserve-self-signed-certs\""
Sep 08 16:02:50.794049 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.793781    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-a09aa5\"/\"kube-root-ca.crt\""
Sep 08 16:02:50.802178 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.802113    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"]
Sep 08 16:02:50.838917 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.838352    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tls-certs\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.838917 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.838410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-dshm\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.838917 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.838441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tmp-dir\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.838917 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.838502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-model-cache\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.838917 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.838543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk5kx\" (UniqueName: \"kubernetes.io/projected/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-kube-api-access-kk5kx\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.838917 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.838579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-home\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.839569 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.839497    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:50.866416 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.866373    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:50.866725 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.866701    2581 patch_prober.go:28] interesting pod/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 08 16:02:50.866864 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.866769    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 08 16:02:50.940845 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.940202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk5kx\" (UniqueName: \"kubernetes.io/projected/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-kube-api-access-kk5kx\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.940845 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.940343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-home\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.940845 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.940482    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tls-certs\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.940845 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.940518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-dshm\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.940845 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.940549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tmp-dir\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.940845 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.940630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-model-cache\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.941326 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.941167    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-model-cache\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.941865 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.941699    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-home\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.942069 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.942046    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tmp-dir\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.945534 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.944579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-dshm\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.945534 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.945434    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tls-certs\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:50.949417 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:50.949391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk5kx\" (UniqueName: \"kubernetes.io/projected/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-kube-api-access-kk5kx\") pod \"auth-test-model-a09aa5-kserve-64585d95c5-5qzpm\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:51.104791 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:51.104690    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:02:51.406205 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:51.406179    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"]
Sep 08 16:02:51.407128 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:02:51.407095    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd8e54af_765c_4b7d_b881_8d944c5bfe7a.slice/crio-5fa38c96cf0074c000dcfdda3363282feeb273801f0452eef62335e183dc7a77 WatchSource:0}: Error finding container 5fa38c96cf0074c000dcfdda3363282feeb273801f0452eef62335e183dc7a77: Status 404 returned error can't find the container with id 5fa38c96cf0074c000dcfdda3363282feeb273801f0452eef62335e183dc7a77
Sep 08 16:02:51.571895 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:51.571858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm" event={"ID":"cd8e54af-765c-4b7d-b881-8d944c5bfe7a","Type":"ContainerStarted","Data":"c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862"}
Sep 08 16:02:51.571895 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:51.571906    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm" event={"ID":"cd8e54af-765c-4b7d-b881-8d944c5bfe7a","Type":"ContainerStarted","Data":"5fa38c96cf0074c000dcfdda3363282feeb273801f0452eef62335e183dc7a77"}
Sep 08 16:02:51.591673 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:51.591617    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm" podStartSLOduration=1.5916003170000002 podStartE2EDuration="1.591600317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:02:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:02:51.588721308 +0000 UTC m=+1099.710876923" watchObservedRunningTime="2026-09-08 16:02:51.591600317 +0000 UTC m=+1099.713755959"
Sep 08 16:02:51.866283 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:51.866194    2581 patch_prober.go:28] interesting pod/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 08 16:02:51.866283 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:51.866253    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 08 16:02:52.866523 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:52.866484    2581 patch_prober.go:28] interesting pod/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 08 16:02:52.867045 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:52.866553    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 08 16:02:53.866356 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:53.866321    2581 patch_prober.go:28] interesting pod/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 08 16:02:53.866535 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:53.866376    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 08 16:02:54.866297 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:54.866254    2581 patch_prober.go:28] interesting pod/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 08 16:02:54.866690 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:54.866324    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 08 16:02:55.481422 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:55.481379    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:02:55.865909 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:55.865791    2581 patch_prober.go:28] interesting pod/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 08 16:02:55.865909 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:55.865868    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 08 16:02:56.334637 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:56.334597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:56.870178 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:56.870146    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:56.870457 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:56.870435    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:02:56.871311 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:02:56.871291    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:03:01.105842 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:01.105776    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:03:01.106300 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:01.105879    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:03:01.118738 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:01.118705    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:03:01.643538 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:01.643506    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:03:12.590973 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:12.590938    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:03:18.312885 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:18.312840    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:03:26.035555 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:26.035514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:03:26.582227 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:26.582187    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:03:42.009747 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:42.009697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:03:45.778204 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:45.778164    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:03:57.290955 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:57.290871    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:03:57.356562 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:57.356520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:03:57.456698 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:57.456665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:03:57.538678 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:03:57.538646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:00.751728 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:00.751692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:04.883124 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:04.883084    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:04:05.824321 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:05.824287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:21.475489 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:21.475451    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:04:35.778559 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:35.778515    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:04:43.364260 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:43.364222    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:43.460420 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:43.460383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:48.531997 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:48.531956    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:55.883981 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:55.883940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:04:57.390623 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:57.390584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:59.149749 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:59.149713    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"]
Sep 08 16:04:59.172102 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:04:59.172070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:02.756759 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:02.756725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:02.821783 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:02.821748    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:02.988673 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:02.988636    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"]
Sep 08 16:05:02.988918 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:02.988882    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy" containerID="cri-o://76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a" gracePeriod=30
Sep 08 16:05:03.009361 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:03.009276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:04.268745 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:04.268706    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:04.372617 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:04.372578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:04.490194 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:04.490148    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:05.108303 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:05.108231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:05.894323 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:05.894285    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:05.995232 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:05.995199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:06.363695 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:06.363666    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:06.611022 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:06.610953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:08.251013 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.250938    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:05:08.398834 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.398775    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-certs\") pod \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") "
Sep 08 16:05:08.399049 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.398875    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-data\") pod \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") "
Sep 08 16:05:08.399049 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.398899    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-credential-socket\") pod \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") "
Sep 08 16:05:08.399049 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.398933    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkqqc\" (UniqueName: \"kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-kube-api-access-zkqqc\") pod \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") "
Sep 08 16:05:08.399049 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399027    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istiod-ca-cert\") pod \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") "
Sep 08 16:05:08.399281 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399070    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-token\") pod \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") "
Sep 08 16:05:08.399281 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399100    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-podinfo\") pod \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") "
Sep 08 16:05:08.399281 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399130    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-envoy\") pod \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") "
Sep 08 16:05:08.399281 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399160    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-socket\") pod \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\" (UID: \"5ec19b90-3597-4646-a7ed-edb59ec4a8a7\") "
Sep 08 16:05:08.399281 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399190    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ec19b90-3597-4646-a7ed-edb59ec4a8a7" (UID: "5ec19b90-3597-4646-a7ed-edb59ec4a8a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:05:08.399497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399272    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ec19b90-3597-4646-a7ed-edb59ec4a8a7" (UID: "5ec19b90-3597-4646-a7ed-edb59ec4a8a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:05:08.399497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ec19b90-3597-4646-a7ed-edb59ec4a8a7" (UID: "5ec19b90-3597-4646-a7ed-edb59ec4a8a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:05:08.399613 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399504    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ec19b90-3597-4646-a7ed-edb59ec4a8a7" (UID: "5ec19b90-3597-4646-a7ed-edb59ec4a8a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:05:08.399613 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399547    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ec19b90-3597-4646-a7ed-edb59ec4a8a7" (UID: "5ec19b90-3597-4646-a7ed-edb59ec4a8a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:05:08.399613 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399597    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:08.399742 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399615    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-workload-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:08.399742 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399629    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-data\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:08.399742 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.399643    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-credential-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:08.401473 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.401440    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ec19b90-3597-4646-a7ed-edb59ec4a8a7" (UID: "5ec19b90-3597-4646-a7ed-edb59ec4a8a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:05:08.401866 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.401816    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-kube-api-access-zkqqc" (OuterVolumeSpecName: "kube-api-access-zkqqc") pod "5ec19b90-3597-4646-a7ed-edb59ec4a8a7" (UID: "5ec19b90-3597-4646-a7ed-edb59ec4a8a7"). InnerVolumeSpecName "kube-api-access-zkqqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:05:08.401866 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.401853    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ec19b90-3597-4646-a7ed-edb59ec4a8a7" (UID: "5ec19b90-3597-4646-a7ed-edb59ec4a8a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:05:08.402008 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.401902    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ec19b90-3597-4646-a7ed-edb59ec4a8a7" (UID: "5ec19b90-3597-4646-a7ed-edb59ec4a8a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:05:08.403679 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.403654    2581 generic.go:356] "Generic (PLEG): container finished" podID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerID="76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a" exitCode=0
Sep 08 16:05:08.403801 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.403707    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"
Sep 08 16:05:08.403801 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.403748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" event={"ID":"5ec19b90-3597-4646-a7ed-edb59ec4a8a7","Type":"ContainerDied","Data":"76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a"}
Sep 08 16:05:08.403937 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.403814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4" event={"ID":"5ec19b90-3597-4646-a7ed-edb59ec4a8a7","Type":"ContainerDied","Data":"0f2e83977a0ce5834238941de1675982950de1de3672b7557e709181afbe4d4b"}
Sep 08 16:05:08.403937 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.403858    2581 scope.go:117] "RemoveContainer" containerID="76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a"
Sep 08 16:05:08.429679 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.429633    2581 scope.go:117] "RemoveContainer" containerID="7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8"
Sep 08 16:05:08.440562 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.440528    2581 scope.go:117] "RemoveContainer" containerID="76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a"
Sep 08 16:05:08.441106 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:05:08.441072    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a\": container with ID starting with 76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a not found: ID does not exist" containerID="76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a"
Sep 08 16:05:08.441241 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.441118    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a"} err="failed to get container status \"76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a\": rpc error: code = NotFound desc = could not find container \"76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a\": container with ID starting with 76cf97ce932068053788a2056872eaa408fa26774a8fa0ae2e4a71f4715d489a not found: ID does not exist"
Sep 08 16:05:08.441241 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.441146    2581 scope.go:117] "RemoveContainer" containerID="7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8"
Sep 08 16:05:08.441538 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:05:08.441512    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8\": container with ID starting with 7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8 not found: ID does not exist" containerID="7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8"
Sep 08 16:05:08.441599 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.441548    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8"} err="failed to get container status \"7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8\": rpc error: code = NotFound desc = could not find container \"7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8\": container with ID starting with 7090855abf841834a4c846cfe809a4cb83193fe9785217c73f19ad7c21f26bd8 not found: ID does not exist"
Sep 08 16:05:08.443907 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.443881    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"]
Sep 08 16:05:08.447296 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.447271    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-510a51a5-openshift-default-64cd9cc5fb-s87p4"]
Sep 08 16:05:08.500366 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.500319    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkqqc\" (UniqueName: \"kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-kube-api-access-zkqqc\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:08.500366 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.500353    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istiod-ca-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:08.500366 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.500369    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-token\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:08.500613 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.500379    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-podinfo\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:08.500613 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.500390    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ec19b90-3597-4646-a7ed-edb59ec4a8a7-istio-envoy\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:08.741494 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.741448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:08.798600 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:08.798566    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:09.980496 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:09.980454    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:05:10.367211 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:10.367129    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" path="/var/lib/kubelet/pods/5ec19b90-3597-4646-a7ed-edb59ec4a8a7/volumes"
Sep 08 16:05:12.303161 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:12.303122    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:12.404466 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:12.404433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:12.943838 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:12.943794    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:14.171285 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.171241    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm" podUID="cd8e54af-765c-4b7d-b881-8d944c5bfe7a" containerName="main" containerID="cri-o://c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862" gracePeriod=45
Sep 08 16:05:14.424817 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.424747    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:05:14.443220 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.443180    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd8e54af-765c-4b7d-b881-8d944c5bfe7a" containerID="c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862" exitCode=0
Sep 08 16:05:14.443417 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.443237    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"
Sep 08 16:05:14.443417 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.443340    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm" event={"ID":"cd8e54af-765c-4b7d-b881-8d944c5bfe7a","Type":"ContainerDied","Data":"c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862"}
Sep 08 16:05:14.443417 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.443374    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm" event={"ID":"cd8e54af-765c-4b7d-b881-8d944c5bfe7a","Type":"ContainerDied","Data":"5fa38c96cf0074c000dcfdda3363282feeb273801f0452eef62335e183dc7a77"}
Sep 08 16:05:14.443417 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.443400    2581 scope.go:117] "RemoveContainer" containerID="c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862"
Sep 08 16:05:14.453127 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.453099    2581 scope.go:117] "RemoveContainer" containerID="c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862"
Sep 08 16:05:14.453510 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:05:14.453484    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862\": container with ID starting with c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862 not found: ID does not exist" containerID="c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862"
Sep 08 16:05:14.453584 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.453518    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862"} err="failed to get container status \"c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862\": rpc error: code = NotFound desc = could not find container \"c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862\": container with ID starting with c5b566a7ddb32be8186300f4c1be9c3c9d4a0f3754e7062070e43fe3c3173862 not found: ID does not exist"
Sep 08 16:05:14.454769 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.454748    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk5kx\" (UniqueName: \"kubernetes.io/projected/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-kube-api-access-kk5kx\") pod \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") "
Sep 08 16:05:14.454888 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.454781    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-model-cache\") pod \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") "
Sep 08 16:05:14.454888 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.454816    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tls-certs\") pod \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") "
Sep 08 16:05:14.454888 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.454885    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-dshm\") pod \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") "
Sep 08 16:05:14.455069 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.454969    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tmp-dir\") pod \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") "
Sep 08 16:05:14.455069 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.455017    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-home\") pod \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\" (UID: \"cd8e54af-765c-4b7d-b881-8d944c5bfe7a\") "
Sep 08 16:05:14.455167 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.455061    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd8e54af-765c-4b7d-b881-8d944c5bfe7a" (UID: "cd8e54af-765c-4b7d-b881-8d944c5bfe7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:05:14.455281 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.455245    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd8e54af-765c-4b7d-b881-8d944c5bfe7a" (UID: "cd8e54af-765c-4b7d-b881-8d944c5bfe7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:05:14.455443 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.455358    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-home" (OuterVolumeSpecName: "home") pod "cd8e54af-765c-4b7d-b881-8d944c5bfe7a" (UID: "cd8e54af-765c-4b7d-b881-8d944c5bfe7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:05:14.455714 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.455691    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tmp-dir\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:14.455780 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.455718    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-home\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:14.455780 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.455731    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-model-cache\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:14.457194 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.457175    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd8e54af-765c-4b7d-b881-8d944c5bfe7a" (UID: "cd8e54af-765c-4b7d-b881-8d944c5bfe7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:05:14.457284 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.457270    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-kube-api-access-kk5kx" (OuterVolumeSpecName: "kube-api-access-kk5kx") pod "cd8e54af-765c-4b7d-b881-8d944c5bfe7a" (UID: "cd8e54af-765c-4b7d-b881-8d944c5bfe7a"). InnerVolumeSpecName "kube-api-access-kk5kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:05:14.457466 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.457453    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-dshm" (OuterVolumeSpecName: "dshm") pod "cd8e54af-765c-4b7d-b881-8d944c5bfe7a" (UID: "cd8e54af-765c-4b7d-b881-8d944c5bfe7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:05:14.556943 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.556898    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk5kx\" (UniqueName: \"kubernetes.io/projected/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-kube-api-access-kk5kx\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:14.556943 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.556936    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-tls-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:14.556943 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.556949    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd8e54af-765c-4b7d-b881-8d944c5bfe7a-dshm\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:05:14.765717 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.765682    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"]
Sep 08 16:05:14.768305 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:14.768282    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/auth-test-model-a09aa5-kserve-64585d95c5-5qzpm"]
Sep 08 16:05:16.365482 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:16.365445    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd8e54af-765c-4b7d-b881-8d944c5bfe7a" path="/var/lib/kubelet/pods/cd8e54af-765c-4b7d-b881-8d944c5bfe7a/volumes"
Sep 08 16:05:18.756870 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:18.756808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:18.828260 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:18.828226    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:18.897585 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:18.897553    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:18.998209 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:18.998173    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:23.578815 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.578762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:05:23.982095 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.982057    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"]
Sep 08 16:05:23.982482 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.982468    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy"
Sep 08 16:05:23.982527 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.982484    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy"
Sep 08 16:05:23.982527 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.982492    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8e54af-765c-4b7d-b881-8d944c5bfe7a" containerName="main"
Sep 08 16:05:23.982527 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.982498    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8e54af-765c-4b7d-b881-8d944c5bfe7a" containerName="main"
Sep 08 16:05:23.982626 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.982577    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy"
Sep 08 16:05:23.982626 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.982589    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8e54af-765c-4b7d-b881-8d944c5bfe7a" containerName="main"
Sep 08 16:05:23.987200 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.987179    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:23.989944 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.989919    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-a09aa5\"/\"openshift-service-ca.crt\""
Sep 08 16:05:23.990091 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.989926    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-a09aa5\"/\"default-dockercfg-shzhl\""
Sep 08 16:05:23.990091 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.989926    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-a09aa5\"/\"sub-test-model-a09aa5-kserve-self-signed-certs\""
Sep 08 16:05:23.990091 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.989966    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-a09aa5\"/\"kube-root-ca.crt\""
Sep 08 16:05:23.996534 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:23.996508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"]
Sep 08 16:05:24.046511 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.046471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tmp-dir\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.046511 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.046510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tls-certs\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.046727 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.046592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-home\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.046727 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.046676    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lrd6\" (UniqueName: \"kubernetes.io/projected/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-kube-api-access-4lrd6\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.046727 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.046715    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-model-cache\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.046862 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.046741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-dshm\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.071812 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.071781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:24.148211 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.148126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-model-cache\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.148211 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.148166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-dshm\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.148452 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.148214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tmp-dir\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.148452 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.148229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tls-certs\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.148452 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.148252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-home\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.148452 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.148308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lrd6\" (UniqueName: \"kubernetes.io/projected/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-kube-api-access-4lrd6\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.148766 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.148549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-model-cache\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.148766 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.148623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tmp-dir\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.148766 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.148667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-home\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.150683 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.150652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-dshm\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.150813 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.150796    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tls-certs\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.158320 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.158291    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lrd6\" (UniqueName: \"kubernetes.io/projected/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-kube-api-access-4lrd6\") pod \"sub-test-model-a09aa5-kserve-5f95b55885-6269q\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") " pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.297509 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.297413    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:24.571683 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:24.571651    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"]
Sep 08 16:05:24.574433 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:05:24.574398    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddde0e67d_5a78_46e9_9c0b_5e4c12b3688e.slice/crio-c4b6f8950bfdf4e151285c1f31ebb43d4d526fc62b67c4a7fc74ba963f6949ca WatchSource:0}: Error finding container c4b6f8950bfdf4e151285c1f31ebb43d4d526fc62b67c4a7fc74ba963f6949ca: Status 404 returned error can't find the container with id c4b6f8950bfdf4e151285c1f31ebb43d4d526fc62b67c4a7fc74ba963f6949ca
Sep 08 16:05:25.513062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:25.513011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q" event={"ID":"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e","Type":"ContainerStarted","Data":"9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b"}
Sep 08 16:05:25.513571 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:25.513071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q" event={"ID":"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e","Type":"ContainerStarted","Data":"c4b6f8950bfdf4e151285c1f31ebb43d4d526fc62b67c4a7fc74ba963f6949ca"}
Sep 08 16:05:25.533332 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:25.533267    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q" podStartSLOduration=2.533249573 podStartE2EDuration="2.533249573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:05:25.53008029 +0000 UTC m=+1253.652235905" watchObservedRunningTime="2026-09-08 16:05:25.533249573 +0000 UTC m=+1253.655405187"
Sep 08 16:05:29.480173 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:29.480137    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:29.684923 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:29.684890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:34.297590 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:34.297555    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:34.298016 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:34.297610    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:34.310128 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:34.310099    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:34.578637 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:34.578554    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:05:34.581756 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:34.581720    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:05:48.282577 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:48.282538    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:05:50.588731 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:50.588686    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:56.432736 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:56.432689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:56.533007 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:56.532969    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:56.793100 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:56.792989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:57.089261 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:57.089162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:57.269202 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:57.269161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:57.927949 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:57.927912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:05:58.729024 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:58.728989    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7950-56717a"]
Sep 08 16:05:58.729641 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:58.729621    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy"
Sep 08 16:05:58.729641 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:58.729641    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy"
Sep 08 16:05:58.729796 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:58.729748    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ec19b90-3597-4646-a7ed-edb59ec4a8a7" containerName="istio-proxy"
Sep 08 16:05:58.734958 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:58.734935    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7950-56717a"
Sep 08 16:05:58.737502 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:58.737474    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5nm68\""
Sep 08 16:05:58.740674 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:58.740647    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7950-56717a"]
Sep 08 16:05:58.785281 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:58.785243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbffm\" (UniqueName: \"kubernetes.io/projected/91e081a9-caf5-4929-b642-5e40f3d18e31-kube-api-access-rbffm\") pod \"mt-curl-7950-56717a\" (UID: \"91e081a9-caf5-4929-b642-5e40f3d18e31\") " pod="opendatahub/mt-curl-7950-56717a"
Sep 08 16:05:58.885987 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:58.885948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbffm\" (UniqueName: \"kubernetes.io/projected/91e081a9-caf5-4929-b642-5e40f3d18e31-kube-api-access-rbffm\") pod \"mt-curl-7950-56717a\" (UID: \"91e081a9-caf5-4929-b642-5e40f3d18e31\") " pod="opendatahub/mt-curl-7950-56717a"
Sep 08 16:05:58.894997 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:58.894967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbffm\" (UniqueName: \"kubernetes.io/projected/91e081a9-caf5-4929-b642-5e40f3d18e31-kube-api-access-rbffm\") pod \"mt-curl-7950-56717a\" (UID: \"91e081a9-caf5-4929-b642-5e40f3d18e31\") " pod="opendatahub/mt-curl-7950-56717a"
Sep 08 16:05:59.046536 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:59.046433    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7950-56717a"
Sep 08 16:05:59.325691 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:59.325660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7950-56717a"]
Sep 08 16:05:59.327415 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:05:59.327383    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91e081a9_caf5_4929_b642_5e40f3d18e31.slice/crio-c5fbec07529813a0b1bb2f18b15f58143c00d73cd7d95c1febfe1395e2f74de7 WatchSource:0}: Error finding container c5fbec07529813a0b1bb2f18b15f58143c00d73cd7d95c1febfe1395e2f74de7: Status 404 returned error can't find the container with id c5fbec07529813a0b1bb2f18b15f58143c00d73cd7d95c1febfe1395e2f74de7
Sep 08 16:05:59.721113 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:05:59.721077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7950-56717a" event={"ID":"91e081a9-caf5-4929-b642-5e40f3d18e31","Type":"ContainerStarted","Data":"c5fbec07529813a0b1bb2f18b15f58143c00d73cd7d95c1febfe1395e2f74de7"}
Sep 08 16:06:00.602330 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:00.602286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:00.697049 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:00.696999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:00.729594 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:00.729561    2581 generic.go:356] "Generic (PLEG): container finished" podID="91e081a9-caf5-4929-b642-5e40f3d18e31" containerID="2fa87b80649e20829647b322ebca1a290923d380a11ceef9460da28ee415d1e1" exitCode=0
Sep 08 16:06:00.729783 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:00.729651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7950-56717a" event={"ID":"91e081a9-caf5-4929-b642-5e40f3d18e31","Type":"ContainerDied","Data":"2fa87b80649e20829647b322ebca1a290923d380a11ceef9460da28ee415d1e1"}
Sep 08 16:06:01.874181 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:01.874150    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7950-56717a"
Sep 08 16:06:01.906692 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:01.906662    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbffm\" (UniqueName: \"kubernetes.io/projected/91e081a9-caf5-4929-b642-5e40f3d18e31-kube-api-access-rbffm\") pod \"91e081a9-caf5-4929-b642-5e40f3d18e31\" (UID: \"91e081a9-caf5-4929-b642-5e40f3d18e31\") "
Sep 08 16:06:01.907491 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:01.907463    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7950-56717a_91e081a9-caf5-4929-b642-5e40f3d18e31/mt-curl-7950-56717a/0.log"
Sep 08 16:06:01.908885 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:01.908855    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e081a9-caf5-4929-b642-5e40f3d18e31-kube-api-access-rbffm" (OuterVolumeSpecName: "kube-api-access-rbffm") pod "91e081a9-caf5-4929-b642-5e40f3d18e31" (UID: "91e081a9-caf5-4929-b642-5e40f3d18e31"). InnerVolumeSpecName "kube-api-access-rbffm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:06:01.920319 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:01.920276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:01.931027 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:01.930993    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7950-56717a"]
Sep 08 16:06:01.936460 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:01.936428    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7950-56717a"]
Sep 08 16:06:02.008002 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.007901    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbffm\" (UniqueName: \"kubernetes.io/projected/91e081a9-caf5-4929-b642-5e40f3d18e31-kube-api-access-rbffm\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:06:02.031354 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.031300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:02.065959 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.065920    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7950-89f42b"]
Sep 08 16:06:02.066341 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.066327    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e081a9-caf5-4929-b642-5e40f3d18e31" containerName="mt-curl-7950-56717a"
Sep 08 16:06:02.066393 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.066342    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e081a9-caf5-4929-b642-5e40f3d18e31" containerName="mt-curl-7950-56717a"
Sep 08 16:06:02.066433 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.066411    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e081a9-caf5-4929-b642-5e40f3d18e31" containerName="mt-curl-7950-56717a"
Sep 08 16:06:02.069498 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.069474    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7950-89f42b"
Sep 08 16:06:02.081422 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.081388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7950-89f42b"]
Sep 08 16:06:02.108695 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.108659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swtvb\" (UniqueName: \"kubernetes.io/projected/895f4ab4-453b-4d8b-9557-593bc831612c-kube-api-access-swtvb\") pod \"mt-curl-7950-89f42b\" (UID: \"895f4ab4-453b-4d8b-9557-593bc831612c\") " pod="opendatahub/mt-curl-7950-89f42b"
Sep 08 16:06:02.210003 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.209959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swtvb\" (UniqueName: \"kubernetes.io/projected/895f4ab4-453b-4d8b-9557-593bc831612c-kube-api-access-swtvb\") pod \"mt-curl-7950-89f42b\" (UID: \"895f4ab4-453b-4d8b-9557-593bc831612c\") " pod="opendatahub/mt-curl-7950-89f42b"
Sep 08 16:06:02.217661 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.217638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swtvb\" (UniqueName: \"kubernetes.io/projected/895f4ab4-453b-4d8b-9557-593bc831612c-kube-api-access-swtvb\") pod \"mt-curl-7950-89f42b\" (UID: \"895f4ab4-453b-4d8b-9557-593bc831612c\") " pod="opendatahub/mt-curl-7950-89f42b"
Sep 08 16:06:02.367146 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.367059    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91e081a9-caf5-4929-b642-5e40f3d18e31" path="/var/lib/kubelet/pods/91e081a9-caf5-4929-b642-5e40f3d18e31/volumes"
Sep 08 16:06:02.379914 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.379883    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7950-89f42b"
Sep 08 16:06:02.502266 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.502230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:02.599075 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.599038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:02.658192 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.658158    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7950-89f42b"]
Sep 08 16:06:02.659680 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:06:02.659650    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod895f4ab4_453b_4d8b_9557_593bc831612c.slice/crio-52830b9933c4e1396077fb59d3dd86a822301b96611008c4d84b94fdb28eaec4 WatchSource:0}: Error finding container 52830b9933c4e1396077fb59d3dd86a822301b96611008c4d84b94fdb28eaec4: Status 404 returned error can't find the container with id 52830b9933c4e1396077fb59d3dd86a822301b96611008c4d84b94fdb28eaec4
Sep 08 16:06:02.744139 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.744107    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7950-56717a"
Sep 08 16:06:02.744378 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.744147    2581 scope.go:117] "RemoveContainer" containerID="2fa87b80649e20829647b322ebca1a290923d380a11ceef9460da28ee415d1e1"
Sep 08 16:06:02.745697 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:02.745656    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7950-89f42b" event={"ID":"895f4ab4-453b-4d8b-9557-593bc831612c","Type":"ContainerStarted","Data":"52830b9933c4e1396077fb59d3dd86a822301b96611008c4d84b94fdb28eaec4"}
Sep 08 16:06:03.754232 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:03.754197    2581 generic.go:356] "Generic (PLEG): container finished" podID="895f4ab4-453b-4d8b-9557-593bc831612c" containerID="1c21a2fc7966771b1993e0f45ea15d0abe123d0990a1a2d3c9db1bb1ddbe499e" exitCode=0
Sep 08 16:06:03.754724 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:03.754249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7950-89f42b" event={"ID":"895f4ab4-453b-4d8b-9557-593bc831612c","Type":"ContainerDied","Data":"1c21a2fc7966771b1993e0f45ea15d0abe123d0990a1a2d3c9db1bb1ddbe499e"}
Sep 08 16:06:03.996313 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:03.996275    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:06:04.895017 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:04.894986    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7950-89f42b"
Sep 08 16:06:04.914209 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:04.914182    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7950-89f42b_895f4ab4-453b-4d8b-9557-593bc831612c/mt-curl-7950-89f42b/0.log"
Sep 08 16:06:04.932267 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:04.932236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swtvb\" (UniqueName: \"kubernetes.io/projected/895f4ab4-453b-4d8b-9557-593bc831612c-kube-api-access-swtvb\") pod \"895f4ab4-453b-4d8b-9557-593bc831612c\" (UID: \"895f4ab4-453b-4d8b-9557-593bc831612c\") "
Sep 08 16:06:04.934733 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:04.934700    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/895f4ab4-453b-4d8b-9557-593bc831612c-kube-api-access-swtvb" (OuterVolumeSpecName: "kube-api-access-swtvb") pod "895f4ab4-453b-4d8b-9557-593bc831612c" (UID: "895f4ab4-453b-4d8b-9557-593bc831612c"). InnerVolumeSpecName "kube-api-access-swtvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:06:04.938687 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:04.938656    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7950-89f42b"]
Sep 08 16:06:04.943153 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:04.943124    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7950-89f42b"]
Sep 08 16:06:05.033330 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:05.033229    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swtvb\" (UniqueName: \"kubernetes.io/projected/895f4ab4-453b-4d8b-9557-593bc831612c-kube-api-access-swtvb\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:06:05.766843 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:05.766783    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52830b9933c4e1396077fb59d3dd86a822301b96611008c4d84b94fdb28eaec4"
Sep 08 16:06:05.766843 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:05.766798    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7950-89f42b"
Sep 08 16:06:05.776997 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:06:05.776963    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7950-89f42b\" is forbidden: User \"system:node:ip-10-0-143-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-238.ec2.internal' and this object" podUID="895f4ab4-453b-4d8b-9557-593bc831612c" pod="opendatahub/mt-curl-7950-89f42b"
Sep 08 16:06:06.365583 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:06.365546    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="895f4ab4-453b-4d8b-9557-593bc831612c" path="/var/lib/kubelet/pods/895f4ab4-453b-4d8b-9557-593bc831612c/volumes"
Sep 08 16:06:06.984998 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:06.984950    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:07.950352 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:07.950314    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"]
Sep 08 16:06:07.967752 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:07.967679    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:21.390067 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:21.390026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:06:22.970938 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:22.970869    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q" podUID="dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" containerName="main" containerID="cri-o://9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b" gracePeriod=45
Sep 08 16:06:23.228307 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.228231    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:06:23.310320 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310282    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lrd6\" (UniqueName: \"kubernetes.io/projected/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-kube-api-access-4lrd6\") pod \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") "
Sep 08 16:06:23.310523 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310342    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-model-cache\") pod \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") "
Sep 08 16:06:23.310523 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310369    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tmp-dir\") pod \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") "
Sep 08 16:06:23.310523 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310418    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-dshm\") pod \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") "
Sep 08 16:06:23.310523 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310438    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tls-certs\") pod \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") "
Sep 08 16:06:23.310523 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310455    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-home\") pod \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\" (UID: \"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e\") "
Sep 08 16:06:23.310849 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310679    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" (UID: "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:06:23.310849 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310696    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-model-cache" (OuterVolumeSpecName: "model-cache") pod "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" (UID: "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:06:23.310849 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310800    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-home" (OuterVolumeSpecName: "home") pod "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" (UID: "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:06:23.311027 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310893    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-model-cache\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:06:23.311027 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.310907    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tmp-dir\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:06:23.312638 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.312604    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" (UID: "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:06:23.312638 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.312626    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-dshm" (OuterVolumeSpecName: "dshm") pod "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" (UID: "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:06:23.312797 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.312651    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-kube-api-access-4lrd6" (OuterVolumeSpecName: "kube-api-access-4lrd6") pod "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" (UID: "dde0e67d-5a78-46e9-9c0b-5e4c12b3688e"). InnerVolumeSpecName "kube-api-access-4lrd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:06:23.411771 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.411728    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-dshm\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:06:23.411771 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.411762    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-tls-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:06:23.411771 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.411772    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-home\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:06:23.412052 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.411783    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lrd6\" (UniqueName: \"kubernetes.io/projected/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e-kube-api-access-4lrd6\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:06:23.881357 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.881312    2581 generic.go:356] "Generic (PLEG): container finished" podID="dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" containerID="9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b" exitCode=0
Sep 08 16:06:23.881357 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.881352    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"
Sep 08 16:06:23.881587 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.881397    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q" event={"ID":"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e","Type":"ContainerDied","Data":"9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b"}
Sep 08 16:06:23.881587 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.881442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q" event={"ID":"dde0e67d-5a78-46e9-9c0b-5e4c12b3688e","Type":"ContainerDied","Data":"c4b6f8950bfdf4e151285c1f31ebb43d4d526fc62b67c4a7fc74ba963f6949ca"}
Sep 08 16:06:23.881587 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.881464    2581 scope.go:117] "RemoveContainer" containerID="9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b"
Sep 08 16:06:23.891638 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.891618    2581 scope.go:117] "RemoveContainer" containerID="9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b"
Sep 08 16:06:23.892032 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:06:23.892011    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b\": container with ID starting with 9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b not found: ID does not exist" containerID="9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b"
Sep 08 16:06:23.892127 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.892042    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b"} err="failed to get container status \"9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b\": rpc error: code = NotFound desc = could not find container \"9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b\": container with ID starting with 9e5fa5df8da3f8876e7c4f08b98925ae10d775fa80d9ee84a1aab90841e88b9b not found: ID does not exist"
Sep 08 16:06:23.903111 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.903060    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"]
Sep 08 16:06:23.907123 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:23.907087    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-a09aa5/sub-test-model-a09aa5-kserve-5f95b55885-6269q"]
Sep 08 16:06:24.366299 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:24.366266    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" path="/var/lib/kubelet/pods/dde0e67d-5a78-46e9-9c0b-5e4c12b3688e/volumes"
Sep 08 16:06:25.479937 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:25.479907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:25.938765 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:25.938729    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:26.211660 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.211562    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"]
Sep 08 16:06:26.212032 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.212006    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895f4ab4-453b-4d8b-9557-593bc831612c" containerName="mt-curl-7950-89f42b"
Sep 08 16:06:26.212032 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.212026    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="895f4ab4-453b-4d8b-9557-593bc831612c" containerName="mt-curl-7950-89f42b"
Sep 08 16:06:26.212254 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.212050    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" containerName="main"
Sep 08 16:06:26.212254 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.212059    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" containerName="main"
Sep 08 16:06:26.212254 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.212169    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde0e67d-5a78-46e9-9c0b-5e4c12b3688e" containerName="main"
Sep 08 16:06:26.212254 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.212184    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="895f4ab4-453b-4d8b-9557-593bc831612c" containerName="mt-curl-7950-89f42b"
Sep 08 16:06:26.215245 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.215219    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.217436 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.217411    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b8a099-openshift-default-dockercfg-qkbxq\""
Sep 08 16:06:26.227758 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.227723    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"]
Sep 08 16:06:26.250396 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.250348    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:26.341046 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.340977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-credential-socket\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.341046 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.341028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-envoy\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.341346 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.341062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9vpb\" (UniqueName: \"kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-kube-api-access-t9vpb\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.341346 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.341090    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-data\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.341346 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.341220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-podinfo\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.341346 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.341262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-token\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.341346 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.341309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-socket\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.341346 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.341336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-certs\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.341562 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.341383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istiod-ca-cert\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.442574 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.442526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9vpb\" (UniqueName: \"kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-kube-api-access-t9vpb\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.442574 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.442583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-data\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.442910 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.442617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-podinfo\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.442910 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.442637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-token\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.442910 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.442659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-socket\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.442910 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.442681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-certs\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.442910 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.442860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istiod-ca-cert\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.443196 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.442934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-credential-socket\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.443196 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.442998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-envoy\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.443302 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.443199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-data\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.443302 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.443272    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-socket\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.443413 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.443317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-certs\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.443470 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.443405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-credential-socket\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.443668 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.443646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istiod-ca-cert\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.445229 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.445207    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-envoy\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.445555 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.445533    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-podinfo\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.450913 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.450889    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-token\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.451008 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.450974    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9vpb\" (UniqueName: \"kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-kube-api-access-t9vpb\") pod \"e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") " pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.528604 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.528523    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:26.758315 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.758278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:26.812604 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.812577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"]
Sep 08 16:06:26.815044 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:06:26.815016    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbc0dfb_c8c4_4a97_bd3b_1fc3cd5be84f.slice/crio-5540bfdd02c02d5847223e0f91f6d24736ff23a36f84b82290785dc3fcb9d7e7 WatchSource:0}: Error finding container 5540bfdd02c02d5847223e0f91f6d24736ff23a36f84b82290785dc3fcb9d7e7: Status 404 returned error can't find the container with id 5540bfdd02c02d5847223e0f91f6d24736ff23a36f84b82290785dc3fcb9d7e7
Sep 08 16:06:26.817837 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.817787    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:06:26.817936 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.817893    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:06:26.817936 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.817923    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:06:26.905000 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.904956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" event={"ID":"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f","Type":"ContainerStarted","Data":"405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78"}
Sep 08 16:06:26.905183 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.905022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" event={"ID":"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f","Type":"ContainerStarted","Data":"5540bfdd02c02d5847223e0f91f6d24736ff23a36f84b82290785dc3fcb9d7e7"}
Sep 08 16:06:26.927797 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:26.927721    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" podStartSLOduration=0.927697147 podStartE2EDuration="927.697147ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:06:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:06:26.924591535 +0000 UTC m=+1315.046747151" watchObservedRunningTime="2026-09-08 16:06:26.927697147 +0000 UTC m=+1315.049852763"
Sep 08 16:06:27.529436 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:27.529396    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:27.535175 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:27.535147    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:27.911412 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:27.911390    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:27.912590 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:27.912567    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:28.868631 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:28.868596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:28.968132 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:28.968076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:29.993306 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:29.993273    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"]
Sep 08 16:06:29.996266 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:29.996245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:29.998984 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:29.998961    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-b8a099-serving-cert\""
Sep 08 16:06:30.011877 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.011843    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"]
Sep 08 16:06:30.079357 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.079324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djkwr\" (UniqueName: \"kubernetes.io/projected/3311d7fc-1d6a-4274-ba09-2366352a8de7-kube-api-access-djkwr\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.079520 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.079384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-maas-api-tls\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.079520 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.079424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3311d7fc-1d6a-4274-ba09-2366352a8de7-openshift-service-ca\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.079727 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.079694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-metrics-certs\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.135892 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.135853    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:30.188802 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.188757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-metrics-certs\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.189010 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.188893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djkwr\" (UniqueName: \"kubernetes.io/projected/3311d7fc-1d6a-4274-ba09-2366352a8de7-kube-api-access-djkwr\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.189010 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.188922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-maas-api-tls\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.189010 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.188950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3311d7fc-1d6a-4274-ba09-2366352a8de7-openshift-service-ca\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.189585 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.189554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3311d7fc-1d6a-4274-ba09-2366352a8de7-openshift-service-ca\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.191278 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.191252    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-maas-api-tls\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.191387 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.191284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-metrics-certs\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.196539 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.196513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djkwr\" (UniqueName: \"kubernetes.io/projected/3311d7fc-1d6a-4274-ba09-2366352a8de7-kube-api-access-djkwr\") pod \"maas-api-e2e-api-b-b8a099-b76464d7c-scf6j\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.235848 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.235786    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:30.308095 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.308005    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:30.581994 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.581907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:30.588216 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.588187    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"]
Sep 08 16:06:30.590027 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:06:30.590000    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3311d7fc_1d6a_4274_ba09_2366352a8de7.slice/crio-77f580a0ff993e074b23ec42a370413595e7ffd37a0086496ac27ddb62489271 WatchSource:0}: Error finding container 77f580a0ff993e074b23ec42a370413595e7ffd37a0086496ac27ddb62489271: Status 404 returned error can't find the container with id 77f580a0ff993e074b23ec42a370413595e7ffd37a0086496ac27ddb62489271
Sep 08 16:06:30.591493 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.591472    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:06:30.930671 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:30.930636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j" event={"ID":"3311d7fc-1d6a-4274-ba09-2366352a8de7","Type":"ContainerStarted","Data":"77f580a0ff993e074b23ec42a370413595e7ffd37a0086496ac27ddb62489271"}
Sep 08 16:06:31.503754 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.503718    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"]
Sep 08 16:06:31.507548 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.507524    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.511737 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.511707    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-108124\"/\"openshift-service-ca.crt\""
Sep 08 16:06:31.511905 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.511799    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-108124\"/\"default-dockercfg-rch8r\""
Sep 08 16:06:31.511994 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.511954    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-108124\"/\"rate-test-model-108124-kserve-self-signed-certs\""
Sep 08 16:06:31.512451 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.512429    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-108124\"/\"kube-root-ca.crt\""
Sep 08 16:06:31.572379 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.572330    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:31.582531 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.582498    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"]
Sep 08 16:06:31.604164 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.604122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-model-cache\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.604313 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.604175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-dshm\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.604313 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.604255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-home\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.604313 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.604274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681e1b7a-cb12-48bf-b940-3f150cba31aa-tls-certs\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.604313 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.604308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-tmp-dir\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.604467 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.604336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86jrq\" (UniqueName: \"kubernetes.io/projected/681e1b7a-cb12-48bf-b940-3f150cba31aa-kube-api-access-86jrq\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.705341 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.705279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-model-cache\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.705341 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.705344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-dshm\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.705611 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.705384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-home\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.705611 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.705406    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681e1b7a-cb12-48bf-b940-3f150cba31aa-tls-certs\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.705611 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.705428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-tmp-dir\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.705611 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.705469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86jrq\" (UniqueName: \"kubernetes.io/projected/681e1b7a-cb12-48bf-b940-3f150cba31aa-kube-api-access-86jrq\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.705858 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.705705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-model-cache\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.705858 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.705766    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-home\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.705982 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.705927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-tmp-dir\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.707918 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.707888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-dshm\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.708120 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.708106    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681e1b7a-cb12-48bf-b940-3f150cba31aa-tls-certs\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.713339 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.713312    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86jrq\" (UniqueName: \"kubernetes.io/projected/681e1b7a-cb12-48bf-b940-3f150cba31aa-kube-api-access-86jrq\") pod \"rate-test-model-108124-kserve-7c4d5847f-dhl6v\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") " pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.819000 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.818917    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:31.871427 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.871389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:31.939363 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.939324    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j" event={"ID":"3311d7fc-1d6a-4274-ba09-2366352a8de7","Type":"ContainerStarted","Data":"a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303"}
Sep 08 16:06:31.939550 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.939395    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:31.960937 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:31.960706    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j" podStartSLOduration=2.607437202 podStartE2EDuration="2.960680594s" totalImagesPullingTime="353.243392ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:06:31.95680169 +0000 UTC m=+1320.078957306" watchObservedRunningTime="2026-09-08 16:06:31.960680594 +0000 UTC m=+1320.082836212"
Sep 08 16:06:32.101887 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:32.101855    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"]
Sep 08 16:06:32.102959 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:06:32.102931    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod681e1b7a_cb12_48bf_b940_3f150cba31aa.slice/crio-742ee66914e679aad19a4fbfe11c9466500415894c663934c35afed8a5d8cc41 WatchSource:0}: Error finding container 742ee66914e679aad19a4fbfe11c9466500415894c663934c35afed8a5d8cc41: Status 404 returned error can't find the container with id 742ee66914e679aad19a4fbfe11c9466500415894c663934c35afed8a5d8cc41
Sep 08 16:06:32.957284 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:32.957242    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v" event={"ID":"681e1b7a-cb12-48bf-b940-3f150cba31aa","Type":"ContainerStarted","Data":"cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09"}
Sep 08 16:06:32.957284 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:32.957291    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v" event={"ID":"681e1b7a-cb12-48bf-b940-3f150cba31aa","Type":"ContainerStarted","Data":"742ee66914e679aad19a4fbfe11c9466500415894c663934c35afed8a5d8cc41"}
Sep 08 16:06:32.975564 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:32.975508    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v" podStartSLOduration=1.975491308 podStartE2EDuration="1.975491308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:06:32.973130183 +0000 UTC m=+1321.095285802" watchObservedRunningTime="2026-09-08 16:06:32.975491308 +0000 UTC m=+1321.097646956"
Sep 08 16:06:35.764303 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:35.764264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:36.327033 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:36.327000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:37.963389 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:37.963359    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:06:38.486431 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:38.486393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:06:41.820147 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:41.820104    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:41.820747 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:41.820724    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:41.850095 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:41.850058    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:42.046962 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:42.046930    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:06:42.712873 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:42.712806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:42.814010 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:42.813967    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:49.068501 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:49.068468    2581 generic.go:356] "Generic (PLEG): container finished" podID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerID="405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78" exitCode=0
Sep 08 16:06:49.068980 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:49.068540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" event={"ID":"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f","Type":"ContainerDied","Data":"405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78"}
Sep 08 16:06:49.068980 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:49.068968    2581 scope.go:117] "RemoveContainer" containerID="405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78"
Sep 08 16:06:49.070111 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:49.070083    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:06:49.070175 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:49.070154    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:06:49.070214 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:49.070187    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:06:50.077791 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:50.077752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" event={"ID":"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f","Type":"ContainerStarted","Data":"64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882"}
Sep 08 16:06:50.529774 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:50.529700    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:50.530238 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:50.530204    2581 patch_prober.go:28] interesting pod/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 16:06:50.530495 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:50.530466    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 16:06:51.008019 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:51.007979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:51.529533 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:51.529489    2581 patch_prober.go:28] interesting pod/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 16:06:51.530193 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:51.530155    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 16:06:52.530181 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:52.530127    2581 patch_prober.go:28] interesting pod/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 16:06:52.530841 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:52.530203    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 16:06:53.529199 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:53.529146    2581 patch_prober.go:28] interesting pod/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 16:06:53.529423 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:53.529223    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 16:06:53.823573 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:53.823464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:54.529391 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:54.529342    2581 patch_prober.go:28] interesting pod/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 16:06:54.529606 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:54.529414    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 16:06:55.529931 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:55.529876    2581 patch_prober.go:28] interesting pod/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 16:06:55.530330 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:55.529987    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 16:06:56.533800 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:56.533767    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:56.534214 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:56.534130    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:56.534955 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:56.534928    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:06:56.729715 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:06:56.729678    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:01.202110 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:01.202071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:04.501275 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:04.501207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:06.586337 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:06.586296    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:07:06.789573 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:06.789515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:11.002371 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:11.002335    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:12.502973 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:12.502908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:12.574593 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:12.574534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:12.676462 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:12.676411    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:12.775839 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:12.775736    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:13.053229 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:13.053141    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:18.763534 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:18.763498    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:18.832998 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:18.832960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:19.019066 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:19.018979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:19.634029 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:19.633994    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:19.988864 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:19.988811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:07:34.804733 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:34.804690    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"]
Sep 08 16:07:34.805388 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:34.805011    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j" podUID="3311d7fc-1d6a-4274-ba09-2366352a8de7" containerName="maas-api" containerID="cri-o://a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303" gracePeriod=30
Sep 08 16:07:34.844421 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:34.844389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:34.944090 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:34.944049    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:35.067437 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.067368    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:07:35.156276 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.156241    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djkwr\" (UniqueName: \"kubernetes.io/projected/3311d7fc-1d6a-4274-ba09-2366352a8de7-kube-api-access-djkwr\") pod \"3311d7fc-1d6a-4274-ba09-2366352a8de7\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") "
Sep 08 16:07:35.156452 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.156309    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-maas-api-tls\") pod \"3311d7fc-1d6a-4274-ba09-2366352a8de7\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") "
Sep 08 16:07:35.156452 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.156337    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3311d7fc-1d6a-4274-ba09-2366352a8de7-openshift-service-ca\") pod \"3311d7fc-1d6a-4274-ba09-2366352a8de7\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") "
Sep 08 16:07:35.156452 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.156376    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-metrics-certs\") pod \"3311d7fc-1d6a-4274-ba09-2366352a8de7\" (UID: \"3311d7fc-1d6a-4274-ba09-2366352a8de7\") "
Sep 08 16:07:35.156734 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.156707    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3311d7fc-1d6a-4274-ba09-2366352a8de7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3311d7fc-1d6a-4274-ba09-2366352a8de7" (UID: "3311d7fc-1d6a-4274-ba09-2366352a8de7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:07:35.158559 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.158527    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3311d7fc-1d6a-4274-ba09-2366352a8de7" (UID: "3311d7fc-1d6a-4274-ba09-2366352a8de7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:07:35.158708 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.158606    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3311d7fc-1d6a-4274-ba09-2366352a8de7" (UID: "3311d7fc-1d6a-4274-ba09-2366352a8de7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:07:35.158778 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.158758    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3311d7fc-1d6a-4274-ba09-2366352a8de7-kube-api-access-djkwr" (OuterVolumeSpecName: "kube-api-access-djkwr") pod "3311d7fc-1d6a-4274-ba09-2366352a8de7" (UID: "3311d7fc-1d6a-4274-ba09-2366352a8de7"). InnerVolumeSpecName "kube-api-access-djkwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:07:35.258132 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.258088    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djkwr\" (UniqueName: \"kubernetes.io/projected/3311d7fc-1d6a-4274-ba09-2366352a8de7-kube-api-access-djkwr\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:35.258132 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.258124    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-maas-api-tls\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:35.258132 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.258135    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3311d7fc-1d6a-4274-ba09-2366352a8de7-openshift-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:35.258132 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.258144    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3311d7fc-1d6a-4274-ba09-2366352a8de7-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:35.361544 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.361452    2581 generic.go:356] "Generic (PLEG): container finished" podID="3311d7fc-1d6a-4274-ba09-2366352a8de7" containerID="a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303" exitCode=0
Sep 08 16:07:35.361544 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.361497    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"
Sep 08 16:07:35.361744 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.361538    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j" event={"ID":"3311d7fc-1d6a-4274-ba09-2366352a8de7","Type":"ContainerDied","Data":"a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303"}
Sep 08 16:07:35.361744 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.361594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j" event={"ID":"3311d7fc-1d6a-4274-ba09-2366352a8de7","Type":"ContainerDied","Data":"77f580a0ff993e074b23ec42a370413595e7ffd37a0086496ac27ddb62489271"}
Sep 08 16:07:35.361744 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.361624    2581 scope.go:117] "RemoveContainer" containerID="a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303"
Sep 08 16:07:35.371593 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.371575    2581 scope.go:117] "RemoveContainer" containerID="a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303"
Sep 08 16:07:35.371945 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:07:35.371923    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303\": container with ID starting with a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303 not found: ID does not exist" containerID="a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303"
Sep 08 16:07:35.372010 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.371957    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303"} err="failed to get container status \"a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303\": rpc error: code = NotFound desc = could not find container \"a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303\": container with ID starting with a5d76e305c10bc351818e6bb392915d01b5df146ac7524035f5e645cf1b40303 not found: ID does not exist"
Sep 08 16:07:35.384431 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.384398    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"]
Sep 08 16:07:35.389075 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:35.389046    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b8a099-b76464d7c-scf6j"]
Sep 08 16:07:36.059476 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:36.059431    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:36.159660 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:36.159627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:36.366265 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:36.366180    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3311d7fc-1d6a-4274-ba09-2366352a8de7" path="/var/lib/kubelet/pods/3311d7fc-1d6a-4274-ba09-2366352a8de7/volumes"
Sep 08 16:07:40.178738 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:40.178700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:07:41.311218 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:41.311182    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:41.381488 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:41.381441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:41.548190 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:41.548152    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"]
Sep 08 16:07:41.548424 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:41.548398    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy" containerID="cri-o://64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882" gracePeriod=30
Sep 08 16:07:41.570155 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:41.570056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:42.136278 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:42.136240    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:44.762571 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:44.762530    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"]
Sep 08 16:07:44.784416 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:44.784385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:46.011815 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.011780    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:46.449623 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.449590    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:46.763191 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.763131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:46.827370 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.827071    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:07:46.876659 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.876630    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-envoy\") pod \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") "
Sep 08 16:07:46.876875 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.876668    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-token\") pod \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") "
Sep 08 16:07:46.876875 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.876690    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-podinfo\") pod \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") "
Sep 08 16:07:46.876875 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.876763    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-certs\") pod \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") "
Sep 08 16:07:46.876875 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.876787    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9vpb\" (UniqueName: \"kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-kube-api-access-t9vpb\") pod \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") "
Sep 08 16:07:46.876875 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.876864    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-data\") pod \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") "
Sep 08 16:07:46.877157 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.876892    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istiod-ca-cert\") pod \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") "
Sep 08 16:07:46.877157 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.876938    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-credential-socket\") pod \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") "
Sep 08 16:07:46.877157 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.876962    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-socket\") pod \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\" (UID: \"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f\") "
Sep 08 16:07:46.877157 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.877103    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" (UID: "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:46.877366 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.877339    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" (UID: "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:46.877432 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.877367    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-data" (OuterVolumeSpecName: "istio-data") pod "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" (UID: "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:46.877432 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.877407    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" (UID: "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:07:46.877550 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.877444    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:46.877550 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.877464    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-workload-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:46.877650 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.877551    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" (UID: "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:46.879236 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.879206    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" (UID: "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:07:46.879482 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.879451    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-token" (OuterVolumeSpecName: "istio-token") pod "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" (UID: "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:07:46.879585 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.879492    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" (UID: "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:46.879585 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.879558    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-kube-api-access-t9vpb" (OuterVolumeSpecName: "kube-api-access-t9vpb") pod "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" (UID: "4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f"). InnerVolumeSpecName "kube-api-access-t9vpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:07:46.978944 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.978901    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-credential-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:46.978944 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.978937    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-envoy\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:46.978944 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.978948    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-token\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:46.978944 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.978955    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-podinfo\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:46.979218 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.978964    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9vpb\" (UniqueName: \"kubernetes.io/projected/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-kube-api-access-t9vpb\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:46.979218 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.978972    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istio-data\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:46.979218 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.978980    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f-istiod-ca-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:46.989774 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:46.989740    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:47.440908 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.440872    2581 generic.go:356] "Generic (PLEG): container finished" podID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerID="64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882" exitCode=0
Sep 08 16:07:47.441343 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.440928    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"
Sep 08 16:07:47.441343 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.440959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" event={"ID":"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f","Type":"ContainerDied","Data":"64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882"}
Sep 08 16:07:47.441343 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.441009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98" event={"ID":"4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f","Type":"ContainerDied","Data":"5540bfdd02c02d5847223e0f91f6d24736ff23a36f84b82290785dc3fcb9d7e7"}
Sep 08 16:07:47.441343 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.441031    2581 scope.go:117] "RemoveContainer" containerID="64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882"
Sep 08 16:07:47.451667 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.451641    2581 scope.go:117] "RemoveContainer" containerID="405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78"
Sep 08 16:07:47.463299 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.462763    2581 scope.go:117] "RemoveContainer" containerID="64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882"
Sep 08 16:07:47.463618 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:07:47.463589    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882\": container with ID starting with 64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882 not found: ID does not exist" containerID="64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882"
Sep 08 16:07:47.463736 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.463631    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882"} err="failed to get container status \"64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882\": rpc error: code = NotFound desc = could not find container \"64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882\": container with ID starting with 64ed36c4eb1344fe4b35a806934e0e60d2c47878c356209e58eb0de4b9a86882 not found: ID does not exist"
Sep 08 16:07:47.463736 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.463656    2581 scope.go:117] "RemoveContainer" containerID="405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78"
Sep 08 16:07:47.464025 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:07:47.463998    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78\": container with ID starting with 405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78 not found: ID does not exist" containerID="405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78"
Sep 08 16:07:47.464131 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.464032    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78"} err="failed to get container status \"405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78\": rpc error: code = NotFound desc = could not find container \"405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78\": container with ID starting with 405062305d1341aa195d7c9e7ed4c321ff6a1bd52fee946cdbc31168d65ade78 not found: ID does not exist"
Sep 08 16:07:47.466988 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.466965    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"]
Sep 08 16:07:47.473075 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:47.473042    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b8a099-openshift-default-7d989d4c68-wxw98"]
Sep 08 16:07:48.365657 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:48.365619    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" path="/var/lib/kubelet/pods/4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f/volumes"
Sep 08 16:07:50.631786 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:50.631741    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:50.731536 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:50.731500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:51.481988 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.481948    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"]
Sep 08 16:07:51.482355 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.482342    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy"
Sep 08 16:07:51.482355 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.482356    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy"
Sep 08 16:07:51.482540 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.482367    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy"
Sep 08 16:07:51.482540 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.482372    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy"
Sep 08 16:07:51.482540 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.482384    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3311d7fc-1d6a-4274-ba09-2366352a8de7" containerName="maas-api"
Sep 08 16:07:51.482540 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.482389    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3311d7fc-1d6a-4274-ba09-2366352a8de7" containerName="maas-api"
Sep 08 16:07:51.482540 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.482455    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3311d7fc-1d6a-4274-ba09-2366352a8de7" containerName="maas-api"
Sep 08 16:07:51.482540 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.482464    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy"
Sep 08 16:07:51.482540 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.482472    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cbc0dfb-c8c4-4a97-bd3b-1fc3cd5be84f" containerName="istio-proxy"
Sep 08 16:07:51.487027 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.486996    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.489162 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.489134    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-cf851c-serving-cert\""
Sep 08 16:07:51.499325 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.499278    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"]
Sep 08 16:07:51.523665 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.523623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f4sj\" (UniqueName: \"kubernetes.io/projected/ae2fcaa5-2966-4e34-a394-c96966e9a878-kube-api-access-9f4sj\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.523876 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.523748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae2fcaa5-2966-4e34-a394-c96966e9a878-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.523876 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.523791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-metrics-certs\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.523876 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.523841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.527743 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.527717    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:51.625043 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.625003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f4sj\" (UniqueName: \"kubernetes.io/projected/ae2fcaa5-2966-4e34-a394-c96966e9a878-kube-api-access-9f4sj\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.625240 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.625076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae2fcaa5-2966-4e34-a394-c96966e9a878-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.625240 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.625116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-metrics-certs\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.625240 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.625148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.625405 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:07:51.625314    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-serving-cert: secret "maas-api-e2e-ipp-a-cf851c-serving-cert" not found
Sep 08 16:07:51.625405 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:07:51.625390    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-maas-api-tls podName:ae2fcaa5-2966-4e34-a394-c96966e9a878 nodeName:}" failed. No retries permitted until 2026-09-08 16:07:52.12537206 +0000 UTC m=+1400.247527654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-maas-api-tls") pod "maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr" (UID: "ae2fcaa5-2966-4e34-a394-c96966e9a878") : secret "maas-api-e2e-ipp-a-cf851c-serving-cert" not found
Sep 08 16:07:51.625852 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.625807    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:51.625964 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.625947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae2fcaa5-2966-4e34-a394-c96966e9a878-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.627683 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.627664    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-metrics-certs\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.633455 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.633431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f4sj\" (UniqueName: \"kubernetes.io/projected/ae2fcaa5-2966-4e34-a394-c96966e9a878-kube-api-access-9f4sj\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:51.731137 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:51.731097    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:52.015058 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.015000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:52.109346 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.109314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:52.130279 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.130244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:52.133186 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.133145    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:52.292266 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.292169    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"]
Sep 08 16:07:52.292499 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.292463    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc" podUID="1f946ddb-3d03-42b0-bdbc-3244d06bb4ff" containerName="maas-api" containerID="cri-o://b233310573d7955b51ca849eda6aecf6a219f33b384679cef0da67737a352058" gracePeriod=30
Sep 08 16:07:52.317083 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.317044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:52.393066 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.393025    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:52.402095 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.402059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:52.480176 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.480145    2581 generic.go:356] "Generic (PLEG): container finished" podID="1f946ddb-3d03-42b0-bdbc-3244d06bb4ff" containerID="b233310573d7955b51ca849eda6aecf6a219f33b384679cef0da67737a352058" exitCode=0
Sep 08 16:07:52.480325 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.480220    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc" event={"ID":"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff","Type":"ContainerDied","Data":"b233310573d7955b51ca849eda6aecf6a219f33b384679cef0da67737a352058"}
Sep 08 16:07:52.492237 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.492207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:52.569198 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.569096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:52.579696 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.579668    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:07:52.636589 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.636324    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l57w2\" (UniqueName: \"kubernetes.io/projected/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-kube-api-access-l57w2\") pod \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") "
Sep 08 16:07:52.636589 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.636403    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-metrics-certs\") pod \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") "
Sep 08 16:07:52.636589 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.636452    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-maas-api-tls\") pod \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") "
Sep 08 16:07:52.636589 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.636513    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-openshift-service-ca\") pod \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\" (UID: \"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff\") "
Sep 08 16:07:52.637278 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.637176    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1f946ddb-3d03-42b0-bdbc-3244d06bb4ff" (UID: "1f946ddb-3d03-42b0-bdbc-3244d06bb4ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:07:52.639184 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.639160    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1f946ddb-3d03-42b0-bdbc-3244d06bb4ff" (UID: "1f946ddb-3d03-42b0-bdbc-3244d06bb4ff"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:07:52.639481 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.639448    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1f946ddb-3d03-42b0-bdbc-3244d06bb4ff" (UID: "1f946ddb-3d03-42b0-bdbc-3244d06bb4ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:07:52.639481 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.639466    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-kube-api-access-l57w2" (OuterVolumeSpecName: "kube-api-access-l57w2") pod "1f946ddb-3d03-42b0-bdbc-3244d06bb4ff" (UID: "1f946ddb-3d03-42b0-bdbc-3244d06bb4ff"). InnerVolumeSpecName "kube-api-access-l57w2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:07:52.686468 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.686433    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"]
Sep 08 16:07:52.687936 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:07:52.687908    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2fcaa5_2966_4e34_a394_c96966e9a878.slice/crio-c347b616a6e8ec1dbdbef97b13baea98e8ac5b3cc7b0c045be38dfe752448093 WatchSource:0}: Error finding container c347b616a6e8ec1dbdbef97b13baea98e8ac5b3cc7b0c045be38dfe752448093: Status 404 returned error can't find the container with id c347b616a6e8ec1dbdbef97b13baea98e8ac5b3cc7b0c045be38dfe752448093
Sep 08 16:07:52.737879 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.737803    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l57w2\" (UniqueName: \"kubernetes.io/projected/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-kube-api-access-l57w2\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:52.737879 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.737873    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:52.737879 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.737886    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-maas-api-tls\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:52.738135 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.737899    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff-openshift-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:07:52.927466 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:52.927431    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:53.487880 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:53.487845    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"
Sep 08 16:07:53.487880 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:53.487861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc" event={"ID":"1f946ddb-3d03-42b0-bdbc-3244d06bb4ff","Type":"ContainerDied","Data":"a1c3177d27c72c05ebea3649a642c3c0ad4fece1dcf6d08e9f31270de259c980"}
Sep 08 16:07:53.488134 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:53.487919    2581 scope.go:117] "RemoveContainer" containerID="b233310573d7955b51ca849eda6aecf6a219f33b384679cef0da67737a352058"
Sep 08 16:07:53.489502 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:53.489475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr" event={"ID":"ae2fcaa5-2966-4e34-a394-c96966e9a878","Type":"ContainerStarted","Data":"c347b616a6e8ec1dbdbef97b13baea98e8ac5b3cc7b0c045be38dfe752448093"}
Sep 08 16:07:53.517301 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:53.517263    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"]
Sep 08 16:07:53.521031 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:53.521002    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-13d3a5-788ccbd5c9-p4ctc"]
Sep 08 16:07:54.366582 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:54.366547    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f946ddb-3d03-42b0-bdbc-3244d06bb4ff" path="/var/lib/kubelet/pods/1f946ddb-3d03-42b0-bdbc-3244d06bb4ff/volumes"
Sep 08 16:07:56.284232 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:56.284190    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:07:56.511241 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:56.511202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr" event={"ID":"ae2fcaa5-2966-4e34-a394-c96966e9a878","Type":"ContainerStarted","Data":"356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139"}
Sep 08 16:07:56.511450 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:56.511390    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:07:56.547335 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:56.547268    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr" podStartSLOduration=2.129175114 podStartE2EDuration="5.547249646s" totalImagesPullingTime="3.418074532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:07:56.545942625 +0000 UTC m=+1404.668098242" watchObservedRunningTime="2026-09-08 16:07:56.547249646 +0000 UTC m=+1404.669405262"
Sep 08 16:07:59.036348 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:59.036311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:59.137253 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:59.137212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:59.225159 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:59.225126    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"]
Sep 08 16:07:59.225441 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:59.225414    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy" containerID="cri-o://712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31" gracePeriod=30
Sep 08 16:07:59.247844 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:59.247777    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:07:59.248035 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:59.247883    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:07:59.248965 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:59.248941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:59.725533 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:59.725493    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:59.783280 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:59.783238    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v" podUID="681e1b7a-cb12-48bf-b940-3f150cba31aa" containerName="main" containerID="cri-o://cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09" gracePeriod=45
Sep 08 16:07:59.937651 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:07:59.937619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:00.032345 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.032315    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:08:00.109574 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.109539    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86jrq\" (UniqueName: \"kubernetes.io/projected/681e1b7a-cb12-48bf-b940-3f150cba31aa-kube-api-access-86jrq\") pod \"681e1b7a-cb12-48bf-b940-3f150cba31aa\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") "
Sep 08 16:08:00.110115 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.109637    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-tmp-dir\") pod \"681e1b7a-cb12-48bf-b940-3f150cba31aa\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") "
Sep 08 16:08:00.110115 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.109791    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-home\") pod \"681e1b7a-cb12-48bf-b940-3f150cba31aa\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") "
Sep 08 16:08:00.110115 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.109899    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-dshm\") pod \"681e1b7a-cb12-48bf-b940-3f150cba31aa\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") "
Sep 08 16:08:00.110115 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.109924    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-model-cache\") pod \"681e1b7a-cb12-48bf-b940-3f150cba31aa\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") "
Sep 08 16:08:00.110115 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.109924    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "681e1b7a-cb12-48bf-b940-3f150cba31aa" (UID: "681e1b7a-cb12-48bf-b940-3f150cba31aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:08:00.110115 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.110004    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681e1b7a-cb12-48bf-b940-3f150cba31aa-tls-certs\") pod \"681e1b7a-cb12-48bf-b940-3f150cba31aa\" (UID: \"681e1b7a-cb12-48bf-b940-3f150cba31aa\") "
Sep 08 16:08:00.110115 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.110027    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-home" (OuterVolumeSpecName: "home") pod "681e1b7a-cb12-48bf-b940-3f150cba31aa" (UID: "681e1b7a-cb12-48bf-b940-3f150cba31aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:08:00.110409 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.110148    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-model-cache" (OuterVolumeSpecName: "model-cache") pod "681e1b7a-cb12-48bf-b940-3f150cba31aa" (UID: "681e1b7a-cb12-48bf-b940-3f150cba31aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:08:00.110409 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.110398    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-tmp-dir\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:00.110478 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.110418    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-home\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:00.110478 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.110431    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-model-cache\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:00.112017 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.111983    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/681e1b7a-cb12-48bf-b940-3f150cba31aa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "681e1b7a-cb12-48bf-b940-3f150cba31aa" (UID: "681e1b7a-cb12-48bf-b940-3f150cba31aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:08:00.112127 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.112035    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/681e1b7a-cb12-48bf-b940-3f150cba31aa-kube-api-access-86jrq" (OuterVolumeSpecName: "kube-api-access-86jrq") pod "681e1b7a-cb12-48bf-b940-3f150cba31aa" (UID: "681e1b7a-cb12-48bf-b940-3f150cba31aa"). InnerVolumeSpecName "kube-api-access-86jrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:08:00.112127 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.112035    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-dshm" (OuterVolumeSpecName: "dshm") pod "681e1b7a-cb12-48bf-b940-3f150cba31aa" (UID: "681e1b7a-cb12-48bf-b940-3f150cba31aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:08:00.211088 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.211052    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681e1b7a-cb12-48bf-b940-3f150cba31aa-dshm\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:00.211088 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.211084    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681e1b7a-cb12-48bf-b940-3f150cba31aa-tls-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:00.211273 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.211097    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86jrq\" (UniqueName: \"kubernetes.io/projected/681e1b7a-cb12-48bf-b940-3f150cba31aa-kube-api-access-86jrq\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:00.537169 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.537133    2581 generic.go:356] "Generic (PLEG): container finished" podID="681e1b7a-cb12-48bf-b940-3f150cba31aa" containerID="cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09" exitCode=0
Sep 08 16:08:00.537349 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.537181    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"
Sep 08 16:08:00.537349 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.537218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v" event={"ID":"681e1b7a-cb12-48bf-b940-3f150cba31aa","Type":"ContainerDied","Data":"cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09"}
Sep 08 16:08:00.537349 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.537270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v" event={"ID":"681e1b7a-cb12-48bf-b940-3f150cba31aa","Type":"ContainerDied","Data":"742ee66914e679aad19a4fbfe11c9466500415894c663934c35afed8a5d8cc41"}
Sep 08 16:08:00.537349 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.537293    2581 scope.go:117] "RemoveContainer" containerID="cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09"
Sep 08 16:08:00.548896 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.548875    2581 scope.go:117] "RemoveContainer" containerID="cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09"
Sep 08 16:08:00.549226 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:08:00.549203    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09\": container with ID starting with cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09 not found: ID does not exist" containerID="cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09"
Sep 08 16:08:00.549275 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.549237    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09"} err="failed to get container status \"cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09\": rpc error: code = NotFound desc = could not find container \"cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09\": container with ID starting with cc4bcb3a3bcf48a9d340a53da8bc505973b36d3ba4646b9c1a7352c5350bde09 not found: ID does not exist"
Sep 08 16:08:00.554401 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.554374    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"]
Sep 08 16:08:00.558614 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:00.558585    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-108124/rate-test-model-108124-kserve-7c4d5847f-dhl6v"]
Sep 08 16:08:02.366031 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:02.365997    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="681e1b7a-cb12-48bf-b940-3f150cba31aa" path="/var/lib/kubelet/pods/681e1b7a-cb12-48bf-b940-3f150cba31aa/volumes"
Sep 08 16:08:02.524531 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:02.524494    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:08:04.484948 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.484922    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:08:04.549160 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549074    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-credential-socket\") pod \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") "
Sep 08 16:08:04.549160 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549115    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-envoy\") pod \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") "
Sep 08 16:08:04.549160 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549153    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istiod-ca-cert\") pod \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") "
Sep 08 16:08:04.549435 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549186    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zngn2\" (UniqueName: \"kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-kube-api-access-zngn2\") pod \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") "
Sep 08 16:08:04.549435 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549211    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-certs\") pod \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") "
Sep 08 16:08:04.549435 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549227    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-podinfo\") pod \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") "
Sep 08 16:08:04.549435 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549347    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-data\") pod \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") "
Sep 08 16:08:04.549435 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549404    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ec1e460-2dd2-4688-8610-9169e2ce7f0c" (UID: "9ec1e460-2dd2-4688-8610-9169e2ce7f0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:08:04.549435 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549423    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-token\") pod \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") "
Sep 08 16:08:04.549711 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-socket\") pod \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\" (UID: \"9ec1e460-2dd2-4688-8610-9169e2ce7f0c\") "
Sep 08 16:08:04.549711 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549535    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ec1e460-2dd2-4688-8610-9169e2ce7f0c" (UID: "9ec1e460-2dd2-4688-8610-9169e2ce7f0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:08:04.549711 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549620    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ec1e460-2dd2-4688-8610-9169e2ce7f0c" (UID: "9ec1e460-2dd2-4688-8610-9169e2ce7f0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:08:04.549711 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549643    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ec1e460-2dd2-4688-8610-9169e2ce7f0c" (UID: "9ec1e460-2dd2-4688-8610-9169e2ce7f0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:08:04.549968 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549852    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ec1e460-2dd2-4688-8610-9169e2ce7f0c" (UID: "9ec1e460-2dd2-4688-8610-9169e2ce7f0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:08:04.550026 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.549991    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-credential-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:04.550026 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.550011    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istiod-ca-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:04.550026 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.550025    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:04.550184 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.550037    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-data\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:04.550184 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.550049    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-workload-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:04.551548 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.551511    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ec1e460-2dd2-4688-8610-9169e2ce7f0c" (UID: "9ec1e460-2dd2-4688-8610-9169e2ce7f0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:08:04.551676 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.551609    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ec1e460-2dd2-4688-8610-9169e2ce7f0c" (UID: "9ec1e460-2dd2-4688-8610-9169e2ce7f0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:08:04.551676 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.551609    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-kube-api-access-zngn2" (OuterVolumeSpecName: "kube-api-access-zngn2") pod "9ec1e460-2dd2-4688-8610-9169e2ce7f0c" (UID: "9ec1e460-2dd2-4688-8610-9169e2ce7f0c"). InnerVolumeSpecName "kube-api-access-zngn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:08:04.551676 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.551641    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ec1e460-2dd2-4688-8610-9169e2ce7f0c" (UID: "9ec1e460-2dd2-4688-8610-9169e2ce7f0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:08:04.565271 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.565242    2581 generic.go:356] "Generic (PLEG): container finished" podID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerID="712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31" exitCode=0
Sep 08 16:08:04.565436 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.565304    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"
Sep 08 16:08:04.565436 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.565322    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" event={"ID":"9ec1e460-2dd2-4688-8610-9169e2ce7f0c","Type":"ContainerDied","Data":"712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31"}
Sep 08 16:08:04.565436 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.565416    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8" event={"ID":"9ec1e460-2dd2-4688-8610-9169e2ce7f0c","Type":"ContainerDied","Data":"e5c5125bc49647fd9593d5956bfbd7fd399c4491270fc69622ade642e8990cea"}
Sep 08 16:08:04.565595 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.565448    2581 scope.go:117] "RemoveContainer" containerID="712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31"
Sep 08 16:08:04.575568 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.575551    2581 scope.go:117] "RemoveContainer" containerID="3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663"
Sep 08 16:08:04.584948 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.584917    2581 scope.go:117] "RemoveContainer" containerID="712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31"
Sep 08 16:08:04.585350 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:08:04.585324    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31\": container with ID starting with 712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31 not found: ID does not exist" containerID="712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31"
Sep 08 16:08:04.585425 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.585362    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31"} err="failed to get container status \"712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31\": rpc error: code = NotFound desc = could not find container \"712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31\": container with ID starting with 712bb71f7f58b453fe06c7fd29930b02619ff73d8f91d5e74b7f82a6de78ee31 not found: ID does not exist"
Sep 08 16:08:04.585425 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.585387    2581 scope.go:117] "RemoveContainer" containerID="3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663"
Sep 08 16:08:04.585685 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:08:04.585665    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663\": container with ID starting with 3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663 not found: ID does not exist" containerID="3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663"
Sep 08 16:08:04.585749 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.585695    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663"} err="failed to get container status \"3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663\": rpc error: code = NotFound desc = could not find container \"3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663\": container with ID starting with 3ae04d194655eb82868b353dcf0767561e131245a514b961e3ae6bf788bf2663 not found: ID does not exist"
Sep 08 16:08:04.587920 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.587894    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"]
Sep 08 16:08:04.592810 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.592775    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-13d3a5-openshift-default-65df8456b8-bwgz8"]
Sep 08 16:08:04.651506 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.651468    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zngn2\" (UniqueName: \"kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-kube-api-access-zngn2\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:04.651506 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.651502    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-podinfo\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:04.651506 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.651513    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-token\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:04.651747 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:04.651521    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ec1e460-2dd2-4688-8610-9169e2ce7f0c-istio-envoy\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:06.365807 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:06.365766    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" path="/var/lib/kubelet/pods/9ec1e460-2dd2-4688-8610-9169e2ce7f0c/volumes"
Sep 08 16:08:10.105515 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.105479    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"]
Sep 08 16:08:10.105983 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.105728    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd" podUID="d50250c2-a715-4668-8c5e-8c0a61aa8f8d" containerName="maas-api" containerID="cri-o://ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e" gracePeriod=30
Sep 08 16:08:10.132491 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.132449    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:10.232664 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.232633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:10.334081 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.334043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:10.360490 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.360415    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:08:10.454014 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.453976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:10.511383 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.511329    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxs5v\" (UniqueName: \"kubernetes.io/projected/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-kube-api-access-dxs5v\") pod \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") "
Sep 08 16:08:10.511580 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.511443    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-maas-api-tls\") pod \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") "
Sep 08 16:08:10.511580 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.511519    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-openshift-service-ca\") pod \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") "
Sep 08 16:08:10.511753 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.511734    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-metrics-certs\") pod \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\" (UID: \"d50250c2-a715-4668-8c5e-8c0a61aa8f8d\") "
Sep 08 16:08:10.512757 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.511997    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d50250c2-a715-4668-8c5e-8c0a61aa8f8d" (UID: "d50250c2-a715-4668-8c5e-8c0a61aa8f8d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:08:10.512757 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.512286    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-openshift-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:10.515413 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.515382    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d50250c2-a715-4668-8c5e-8c0a61aa8f8d" (UID: "d50250c2-a715-4668-8c5e-8c0a61aa8f8d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:08:10.515572 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.515546    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d50250c2-a715-4668-8c5e-8c0a61aa8f8d" (UID: "d50250c2-a715-4668-8c5e-8c0a61aa8f8d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:08:10.518298 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.518261    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-kube-api-access-dxs5v" (OuterVolumeSpecName: "kube-api-access-dxs5v") pod "d50250c2-a715-4668-8c5e-8c0a61aa8f8d" (UID: "d50250c2-a715-4668-8c5e-8c0a61aa8f8d"). InnerVolumeSpecName "kube-api-access-dxs5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:08:10.603331 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.603292    2581 generic.go:356] "Generic (PLEG): container finished" podID="d50250c2-a715-4668-8c5e-8c0a61aa8f8d" containerID="ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e" exitCode=0
Sep 08 16:08:10.603545 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.603343    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"
Sep 08 16:08:10.603545 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.603382    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd" event={"ID":"d50250c2-a715-4668-8c5e-8c0a61aa8f8d","Type":"ContainerDied","Data":"ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e"}
Sep 08 16:08:10.603545 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.603449    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd" event={"ID":"d50250c2-a715-4668-8c5e-8c0a61aa8f8d","Type":"ContainerDied","Data":"c35e5db85fd799a41022130d10fb4924415e965b2900d19b85d93a7e2f85c56b"}
Sep 08 16:08:10.603545 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.603481    2581 scope.go:117] "RemoveContainer" containerID="ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e"
Sep 08 16:08:10.612781 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.612756    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxs5v\" (UniqueName: \"kubernetes.io/projected/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-kube-api-access-dxs5v\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:10.612781 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.612782    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-maas-api-tls\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:10.612977 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.612796    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d50250c2-a715-4668-8c5e-8c0a61aa8f8d-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:08:10.614060 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.614038    2581 scope.go:117] "RemoveContainer" containerID="ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e"
Sep 08 16:08:10.614377 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:08:10.614357    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e\": container with ID starting with ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e not found: ID does not exist" containerID="ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e"
Sep 08 16:08:10.614449 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.614386    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e"} err="failed to get container status \"ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e\": rpc error: code = NotFound desc = could not find container \"ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e\": container with ID starting with ef63ec8496faa1fde0413e36da939ad70c6492b4e565fe6639ef59e56057543e not found: ID does not exist"
Sep 08 16:08:10.628230 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.628196    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"]
Sep 08 16:08:10.632318 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.632278    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-e69292-794696f888-hjdxd"]
Sep 08 16:08:10.756002 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:10.755971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:12.365856 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:12.365806    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d50250c2-a715-4668-8c5e-8c0a61aa8f8d" path="/var/lib/kubelet/pods/d50250c2-a715-4668-8c5e-8c0a61aa8f8d/volumes"
Sep 08 16:08:12.503236 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:12.503199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:15.283946 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:15.283898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:15.581279 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:15.581190    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:08:15.978286 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:15.978247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:16.255301 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.255216    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"]
Sep 08 16:08:16.255871 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.255837    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy"
Sep 08 16:08:16.255871 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.255860    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy"
Sep 08 16:08:16.255871 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.255876    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f946ddb-3d03-42b0-bdbc-3244d06bb4ff" containerName="maas-api"
Sep 08 16:08:16.256062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.255882    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f946ddb-3d03-42b0-bdbc-3244d06bb4ff" containerName="maas-api"
Sep 08 16:08:16.256062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.255898    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="681e1b7a-cb12-48bf-b940-3f150cba31aa" containerName="main"
Sep 08 16:08:16.256062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.255910    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="681e1b7a-cb12-48bf-b940-3f150cba31aa" containerName="main"
Sep 08 16:08:16.256062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.255934    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d50250c2-a715-4668-8c5e-8c0a61aa8f8d" containerName="maas-api"
Sep 08 16:08:16.256062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.255942    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d50250c2-a715-4668-8c5e-8c0a61aa8f8d" containerName="maas-api"
Sep 08 16:08:16.256062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.256033    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy"
Sep 08 16:08:16.256062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.256045    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="681e1b7a-cb12-48bf-b940-3f150cba31aa" containerName="main"
Sep 08 16:08:16.256062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.256054    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f946ddb-3d03-42b0-bdbc-3244d06bb4ff" containerName="maas-api"
Sep 08 16:08:16.256062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.256063    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy"
Sep 08 16:08:16.256343 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.256073    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d50250c2-a715-4668-8c5e-8c0a61aa8f8d" containerName="maas-api"
Sep 08 16:08:16.260749 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.260724    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.263100 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.263080    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-7a7297-openshift-default-dockercfg-92jhd\""
Sep 08 16:08:16.272917 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.272888    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"]
Sep 08 16:08:16.282677 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.282649    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:16.367959 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.367926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-podinfo\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.367959 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.367958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t94cp\" (UniqueName: \"kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-kube-api-access-t94cp\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.368407 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.367993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-token\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.368407 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.368017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istiod-ca-cert\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.368407 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.368047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-data\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.368407 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.368113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-certs\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.368407 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.368147    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-envoy\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.368407 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.368184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-credential-socket\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.368407 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.368237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-socket\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.405378 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.405315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:16.468990 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.468951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-credential-socket\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.468990 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.468999    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-socket\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-podinfo\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t94cp\" (UniqueName: \"kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-kube-api-access-t94cp\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-token\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istiod-ca-cert\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-data\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-certs\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-envoy\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469649 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-credential-socket\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469712 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-data\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469712 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-certs\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.469795 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.469772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-socket\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.470032 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.470008    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istiod-ca-cert\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.471635 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.471609    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-envoy\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.471888 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.471869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-podinfo\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.485835 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.485795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-token\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.486232 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.486214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t94cp\" (UniqueName: \"kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-kube-api-access-t94cp\") pod \"e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") " pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.572295 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.572174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:16.858098 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.858070    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"]
Sep 08 16:08:16.859187 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:08:16.859164    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb396d4_c829_47a2_addb_39b12b1d7ed6.slice/crio-6cf9881af92f7c68e0502dd98af8d0e845b80141bb107203df661212b647f815 WatchSource:0}: Error finding container 6cf9881af92f7c68e0502dd98af8d0e845b80141bb107203df661212b647f815: Status 404 returned error can't find the container with id 6cf9881af92f7c68e0502dd98af8d0e845b80141bb107203df661212b647f815
Sep 08 16:08:16.861436 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.861397    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:08:16.861546 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.861474    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:08:16.861546 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:16.861504    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:08:17.419229 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:17.419171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:17.489262 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:17.489221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:17.660481 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:17.660438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" event={"ID":"0eb396d4-c829-47a2-addb-39b12b1d7ed6","Type":"ContainerStarted","Data":"e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe"}
Sep 08 16:08:17.660674 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:17.660512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" event={"ID":"0eb396d4-c829-47a2-addb-39b12b1d7ed6","Type":"ContainerStarted","Data":"6cf9881af92f7c68e0502dd98af8d0e845b80141bb107203df661212b647f815"}
Sep 08 16:08:17.685274 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:17.685154    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" podStartSLOduration=1.6851358429999999 podStartE2EDuration="1.685135843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:08:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:08:17.683068224 +0000 UTC m=+1425.805223839" watchObservedRunningTime="2026-09-08 16:08:17.685135843 +0000 UTC m=+1425.807291458"
Sep 08 16:08:17.687007 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:17.686973    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:18.572470 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:18.572433    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:18.577797 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:18.577766    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:18.666887 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:18.666852    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:18.668002 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:18.667979    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:19.593404 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:19.593355    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:19.700302 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:19.700256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:20.932803 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:20.932770    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:21.024758 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:21.024717    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:24.550094 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:24.550006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:24.651040 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:24.651003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:26.295874 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:26.295833    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:27.287991 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:27.287951    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:08:32.544127 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:32.544084    2581 scope.go:117] "RemoveContainer" containerID="41c6d6f65f4e5501df2a77dcf895b882fc3c1e01a2dcb8f3f2619dff4ca8e146"
Sep 08 16:08:35.902583 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:35.902544    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:36.003503 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:36.003446    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:37.788586 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:37.788548    2581 generic.go:356] "Generic (PLEG): container finished" podID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerID="e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe" exitCode=0
Sep 08 16:08:37.789041 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:37.788621    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" event={"ID":"0eb396d4-c829-47a2-addb-39b12b1d7ed6","Type":"ContainerDied","Data":"e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe"}
Sep 08 16:08:37.789086 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:37.789042    2581 scope.go:117] "RemoveContainer" containerID="e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe"
Sep 08 16:08:37.790157 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:37.790129    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:08:37.790219 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:37.790200    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:08:37.790259 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:37.790231    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 16:08:38.796430 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:38.796394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" event={"ID":"0eb396d4-c829-47a2-addb-39b12b1d7ed6","Type":"ContainerStarted","Data":"9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91"}
Sep 08 16:08:39.573238 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:39.573198    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:39.573453 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:39.573425    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 08 16:08:39.573513 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:39.573494    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 08 16:08:40.573383 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:40.573338    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 08 16:08:40.573908 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:40.573404    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 08 16:08:41.573010 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:41.572973    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 08 16:08:41.573200 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:41.573034    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 08 16:08:42.573347 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:42.573299    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 08 16:08:42.573858 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:42.573381    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 08 16:08:42.888216 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:42.888128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:43.572910 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:43.572872    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 08 16:08:43.573105 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:43.572930    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 08 16:08:44.577572 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:44.577535    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:44.577981 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:44.577850    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:44.578699 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:44.578679    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:08:44.605423 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:08:44.605380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:05.874801 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:05.874754    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"]
Sep 08 16:09:05.875448 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:05.875352    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy"
Sep 08 16:09:05.875448 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:05.875375    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec1e460-2dd2-4688-8610-9169e2ce7f0c" containerName="istio-proxy"
Sep 08 16:09:05.877596 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:05.877572    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:05.879878 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:05.879852    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-cf851c\"/\"kube-root-ca.crt\""
Sep 08 16:09:05.880018 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:05.879903    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-cf851c\"/\"openshift-service-ca.crt\""
Sep 08 16:09:05.880612 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:05.880583    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-cf851c\"/\"default-dockercfg-b5t65\""
Sep 08 16:09:05.880713 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:05.880614    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-cf851c\"/\"ipp-route-cf851c-kserve-self-signed-certs\""
Sep 08 16:09:05.887260 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:05.887233    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"]
Sep 08 16:09:06.035788 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.035746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tmp-dir\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.035994 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.035797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tls-certs\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.035994 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.035896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-home\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.035994 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.035957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh58b\" (UniqueName: \"kubernetes.io/projected/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-kube-api-access-vh58b\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.036117 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.036022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-dshm\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.036117 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.036044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-model-cache\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.137417 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.137307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-dshm\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.137417 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.137355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-model-cache\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.137417 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.137391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tmp-dir\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.137725 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.137427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tls-certs\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.137725 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.137467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-home\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.137725 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.137528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh58b\" (UniqueName: \"kubernetes.io/projected/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-kube-api-access-vh58b\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.137897 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.137843    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-model-cache\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.137897 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.137880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tmp-dir\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.138007 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.137927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-home\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.139721 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.139702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-dshm\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.139925 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.139909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tls-certs\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.145930 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.145903    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh58b\" (UniqueName: \"kubernetes.io/projected/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-kube-api-access-vh58b\") pod \"ipp-route-cf851c-kserve-76979c5f8c-5985v\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") " pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.189418 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.189371    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:06.465170 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.465144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"]
Sep 08 16:09:06.466218 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:09:06.466191    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3808ec4b_f1c8_46ee_bc0c_5fd13d953a0d.slice/crio-79b97a5ba09f3bd11f7572c6aff5d4bc5ddde025166b8d84d43048b8cc35fd09 WatchSource:0}: Error finding container 79b97a5ba09f3bd11f7572c6aff5d4bc5ddde025166b8d84d43048b8cc35fd09: Status 404 returned error can't find the container with id 79b97a5ba09f3bd11f7572c6aff5d4bc5ddde025166b8d84d43048b8cc35fd09
Sep 08 16:09:06.982762 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.982721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v" event={"ID":"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d","Type":"ContainerStarted","Data":"3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945"}
Sep 08 16:09:06.983212 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.982770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v" event={"ID":"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d","Type":"ContainerStarted","Data":"79b97a5ba09f3bd11f7572c6aff5d4bc5ddde025166b8d84d43048b8cc35fd09"}
Sep 08 16:09:06.998523 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:06.998378    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v" podStartSLOduration=1.9983556949999999 podStartE2EDuration="1.998355695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:09:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:09:06.997377331 +0000 UTC m=+1475.119532948" watchObservedRunningTime="2026-09-08 16:09:06.998355695 +0000 UTC m=+1475.120511311"
Sep 08 16:09:09.796862 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:09.796808    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:09:10.426138 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:10.426093    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:16.190145 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:16.190095    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:16.190621 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:16.190160    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:16.202794 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:16.202766    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:17.052527 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:17.052487    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:09:24.483197 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:24.483150    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:09:31.176654 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:31.176618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:31.476606 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:31.476522    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:31.808384 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:31.808303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:34.753488 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:34.753450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:34.879745 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:34.879708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:35.992257 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:35.992216    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"]
Sep 08 16:09:35.994814 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:35.994795    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:35.997999 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:35.997973    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-a2951a-serving-cert\""
Sep 08 16:09:36.008309 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.008271    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"]
Sep 08 16:09:36.044395 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.044361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:36.126940 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.126887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.127130 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.126956    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.127130 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.127057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.127130 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.127110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hwff\" (UniqueName: \"kubernetes.io/projected/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-kube-api-access-9hwff\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.147281 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.147244    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:36.228362 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.228326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hwff\" (UniqueName: \"kubernetes.io/projected/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-kube-api-access-9hwff\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.228553 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.228410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.228553 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.228451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.228553 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.228495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.229177 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.229150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.231041 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.231014    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.231147 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.231071    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.236889 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.236863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hwff\" (UniqueName: \"kubernetes.io/projected/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-kube-api-access-9hwff\") pod \"maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.245224 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.245143    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:36.306209 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.306172    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:36.560541 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.560373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:36.585310 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.585282    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"]
Sep 08 16:09:36.587486 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:09:36.587456    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ca0d94_63b5_490e_8aea_1a304b2f0b50.slice/crio-b3d03fbab49257009356f01d01d4a95fb9e2382a46c65b032e16060b0c494964 WatchSource:0}: Error finding container b3d03fbab49257009356f01d01d4a95fb9e2382a46c65b032e16060b0c494964: Status 404 returned error can't find the container with id b3d03fbab49257009356f01d01d4a95fb9e2382a46c65b032e16060b0c494964
Sep 08 16:09:36.657577 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:36.657535    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:09:37.158170 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:37.158134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc" event={"ID":"b4ca0d94-63b5-490e-8aea-1a304b2f0b50","Type":"ContainerStarted","Data":"b3d03fbab49257009356f01d01d4a95fb9e2382a46c65b032e16060b0c494964"}
Sep 08 16:09:38.166377 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:38.166335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc" event={"ID":"b4ca0d94-63b5-490e-8aea-1a304b2f0b50","Type":"ContainerStarted","Data":"58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0"}
Sep 08 16:09:38.166869 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:38.166485    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:38.186359 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:38.186301    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc" podStartSLOduration=2.613258201 podStartE2EDuration="3.186281745s" totalImagesPullingTime="573.023544ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:09:38.184513998 +0000 UTC m=+1506.306669625" watchObservedRunningTime="2026-09-08 16:09:38.186281745 +0000 UTC m=+1506.308437361"
Sep 08 16:09:43.903070 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:43.903024    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:09:44.178084 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:44.178005    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:09:59.755372 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:09:59.755283    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:06.471670 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.471627    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"]
Sep 08 16:10:06.472163 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.471918    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc" podUID="b4ca0d94-63b5-490e-8aea-1a304b2f0b50" containerName="maas-api" containerID="cri-o://58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0" gracePeriod=30
Sep 08 16:10:06.501402 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.501364    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:06.569131 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.569090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:06.732958 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.732891    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:10:06.775296 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.775263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:06.814344 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.814299    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-openshift-service-ca\") pod \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") "
Sep 08 16:10:06.814344 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.814342    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-maas-api-tls\") pod \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") "
Sep 08 16:10:06.814604 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.814371    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hwff\" (UniqueName: \"kubernetes.io/projected/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-kube-api-access-9hwff\") pod \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") "
Sep 08 16:10:06.814604 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.814411    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-metrics-certs\") pod \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\" (UID: \"b4ca0d94-63b5-490e-8aea-1a304b2f0b50\") "
Sep 08 16:10:06.814732 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.814709    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4ca0d94-63b5-490e-8aea-1a304b2f0b50" (UID: "b4ca0d94-63b5-490e-8aea-1a304b2f0b50"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:10:06.817267 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.817207    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b4ca0d94-63b5-490e-8aea-1a304b2f0b50" (UID: "b4ca0d94-63b5-490e-8aea-1a304b2f0b50"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:10:06.817701 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.817673    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4ca0d94-63b5-490e-8aea-1a304b2f0b50" (UID: "b4ca0d94-63b5-490e-8aea-1a304b2f0b50"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:10:06.817701 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.817676    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-kube-api-access-9hwff" (OuterVolumeSpecName: "kube-api-access-9hwff") pod "b4ca0d94-63b5-490e-8aea-1a304b2f0b50" (UID: "b4ca0d94-63b5-490e-8aea-1a304b2f0b50"). InnerVolumeSpecName "kube-api-access-9hwff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:10:06.848179 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.848145    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:06.915302 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.915254    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-openshift-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:06.915302 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.915288    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-maas-api-tls\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:06.915302 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.915298    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hwff\" (UniqueName: \"kubernetes.io/projected/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-kube-api-access-9hwff\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:06.915302 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:06.915306    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ca0d94-63b5-490e-8aea-1a304b2f0b50-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:07.044631 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:07.044552    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:07.342234 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:07.342144    2581 generic.go:356] "Generic (PLEG): container finished" podID="b4ca0d94-63b5-490e-8aea-1a304b2f0b50" containerID="58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0" exitCode=0
Sep 08 16:10:07.342234 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:07.342196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc" event={"ID":"b4ca0d94-63b5-490e-8aea-1a304b2f0b50","Type":"ContainerDied","Data":"58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0"}
Sep 08 16:10:07.342449 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:07.342239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc" event={"ID":"b4ca0d94-63b5-490e-8aea-1a304b2f0b50","Type":"ContainerDied","Data":"b3d03fbab49257009356f01d01d4a95fb9e2382a46c65b032e16060b0c494964"}
Sep 08 16:10:07.342449 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:07.342264    2581 scope.go:117] "RemoveContainer" containerID="58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0"
Sep 08 16:10:07.342449 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:07.342198    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"
Sep 08 16:10:07.352673 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:07.352653    2581 scope.go:117] "RemoveContainer" containerID="58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0"
Sep 08 16:10:07.353088 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:10:07.353067    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0\": container with ID starting with 58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0 not found: ID does not exist" containerID="58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0"
Sep 08 16:10:07.353161 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:07.353104    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0"} err="failed to get container status \"58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0\": rpc error: code = NotFound desc = could not find container \"58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0\": container with ID starting with 58c50d5b2c3fbdba1cb0fc0114ab45c03ab08944761b8828dca888dac6718ce0 not found: ID does not exist"
Sep 08 16:10:07.364740 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:07.364705    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"]
Sep 08 16:10:07.371256 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:07.371227    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2951a-5f57c549d6-66nxc"]
Sep 08 16:10:08.365788 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:08.365747    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ca0d94-63b5-490e-8aea-1a304b2f0b50" path="/var/lib/kubelet/pods/b4ca0d94-63b5-490e-8aea-1a304b2f0b50/volumes"
Sep 08 16:10:10.891965 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:10.891924    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:10:12.955003 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:12.954967    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:13.056503 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:13.056464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:13.229985 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:13.229891    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:17.125314 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:17.125260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:30.384978 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:30.384940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:10:32.508531 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.508493    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"]
Sep 08 16:10:32.509046 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.508700    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr" podUID="ae2fcaa5-2966-4e34-a394-c96966e9a878" containerName="maas-api" containerID="cri-o://356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139" gracePeriod=30
Sep 08 16:10:32.518892 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.518850    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr" podUID="ae2fcaa5-2966-4e34-a394-c96966e9a878" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.75:8443/health\": dial tcp 10.133.0.75:8443: connect: connection refused"
Sep 08 16:10:32.765791 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.765722    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:10:32.870990 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.870947    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-maas-api-tls\") pod \"ae2fcaa5-2966-4e34-a394-c96966e9a878\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") "
Sep 08 16:10:32.871163 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.871012    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae2fcaa5-2966-4e34-a394-c96966e9a878-openshift-service-ca\") pod \"ae2fcaa5-2966-4e34-a394-c96966e9a878\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") "
Sep 08 16:10:32.871163 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.871041    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f4sj\" (UniqueName: \"kubernetes.io/projected/ae2fcaa5-2966-4e34-a394-c96966e9a878-kube-api-access-9f4sj\") pod \"ae2fcaa5-2966-4e34-a394-c96966e9a878\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") "
Sep 08 16:10:32.871163 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.871112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-metrics-certs\") pod \"ae2fcaa5-2966-4e34-a394-c96966e9a878\" (UID: \"ae2fcaa5-2966-4e34-a394-c96966e9a878\") "
Sep 08 16:10:32.871438 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.871401    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae2fcaa5-2966-4e34-a394-c96966e9a878-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae2fcaa5-2966-4e34-a394-c96966e9a878" (UID: "ae2fcaa5-2966-4e34-a394-c96966e9a878"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:10:32.873155 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.873125    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae2fcaa5-2966-4e34-a394-c96966e9a878" (UID: "ae2fcaa5-2966-4e34-a394-c96966e9a878"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:10:32.873155 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.873142    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ae2fcaa5-2966-4e34-a394-c96966e9a878" (UID: "ae2fcaa5-2966-4e34-a394-c96966e9a878"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:10:32.873155 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.873148    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae2fcaa5-2966-4e34-a394-c96966e9a878-kube-api-access-9f4sj" (OuterVolumeSpecName: "kube-api-access-9f4sj") pod "ae2fcaa5-2966-4e34-a394-c96966e9a878" (UID: "ae2fcaa5-2966-4e34-a394-c96966e9a878"). InnerVolumeSpecName "kube-api-access-9f4sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:10:32.959324 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.959291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:32.972199 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.972164    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f4sj\" (UniqueName: \"kubernetes.io/projected/ae2fcaa5-2966-4e34-a394-c96966e9a878-kube-api-access-9f4sj\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:32.972344 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.972206    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:32.972344 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.972215    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae2fcaa5-2966-4e34-a394-c96966e9a878-maas-api-tls\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:32.972344 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:32.972223    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae2fcaa5-2966-4e34-a394-c96966e9a878-openshift-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:33.027029 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.026948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:33.126157 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.126121    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:33.508498 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.508465    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae2fcaa5-2966-4e34-a394-c96966e9a878" containerID="356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139" exitCode=0
Sep 08 16:10:33.508684 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.508509    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"
Sep 08 16:10:33.508684 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.508510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr" event={"ID":"ae2fcaa5-2966-4e34-a394-c96966e9a878","Type":"ContainerDied","Data":"356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139"}
Sep 08 16:10:33.508684 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.508627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr" event={"ID":"ae2fcaa5-2966-4e34-a394-c96966e9a878","Type":"ContainerDied","Data":"c347b616a6e8ec1dbdbef97b13baea98e8ac5b3cc7b0c045be38dfe752448093"}
Sep 08 16:10:33.508684 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.508655    2581 scope.go:117] "RemoveContainer" containerID="356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139"
Sep 08 16:10:33.518454 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.518435    2581 scope.go:117] "RemoveContainer" containerID="356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139"
Sep 08 16:10:33.518777 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:10:33.518758    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139\": container with ID starting with 356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139 not found: ID does not exist" containerID="356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139"
Sep 08 16:10:33.518891 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.518789    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139"} err="failed to get container status \"356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139\": rpc error: code = NotFound desc = could not find container \"356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139\": container with ID starting with 356cdc2a1bb7563ea93d4380abeea9280a0bab95a8dbba876692cace4f3d8139 not found: ID does not exist"
Sep 08 16:10:33.533795 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.533766    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"]
Sep 08 16:10:33.537874 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:33.537843    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf851c-7c8d6d8c66-n6sxr"]
Sep 08 16:10:34.365598 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:34.365567    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae2fcaa5-2966-4e34-a394-c96966e9a878" path="/var/lib/kubelet/pods/ae2fcaa5-2966-4e34-a394-c96966e9a878/volumes"
Sep 08 16:10:38.092225 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:38.092188    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"]
Sep 08 16:10:38.137144 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:38.137112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:10:43.282238 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:43.282197    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:10:53.112764 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.112697    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v" podUID="3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" containerName="main" containerID="cri-o://3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945" gracePeriod=45
Sep 08 16:10:53.363519 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.363447    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:10:53.471365 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.471331    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-dshm\") pod \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") "
Sep 08 16:10:53.471561 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.471394    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-model-cache\") pod \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") "
Sep 08 16:10:53.471561 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.471423    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tmp-dir\") pod \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") "
Sep 08 16:10:53.471561 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.471461    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-home\") pod \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") "
Sep 08 16:10:53.471561 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.471500    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh58b\" (UniqueName: \"kubernetes.io/projected/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-kube-api-access-vh58b\") pod \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") "
Sep 08 16:10:53.471561 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.471531    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tls-certs\") pod \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\" (UID: \"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d\") "
Sep 08 16:10:53.471861 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.471742    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" (UID: "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:10:53.471861 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.471756    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-model-cache" (OuterVolumeSpecName: "model-cache") pod "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" (UID: "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:10:53.471861 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.471771    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-home" (OuterVolumeSpecName: "home") pod "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" (UID: "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:10:53.472518 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.472084    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-home\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:53.472518 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.472112    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-model-cache\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:53.472518 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.472128    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tmp-dir\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:53.473802 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.473778    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-dshm" (OuterVolumeSpecName: "dshm") pod "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" (UID: "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:10:53.473924 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.473816    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-kube-api-access-vh58b" (OuterVolumeSpecName: "kube-api-access-vh58b") pod "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" (UID: "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d"). InnerVolumeSpecName "kube-api-access-vh58b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:10:53.473974 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.473921    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" (UID: "3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:10:53.572787 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.572748    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-dshm\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:53.572787 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.572781    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh58b\" (UniqueName: \"kubernetes.io/projected/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-kube-api-access-vh58b\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:53.572787 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.572793    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d-tls-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:10:53.629946 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.629864    2581 generic.go:356] "Generic (PLEG): container finished" podID="3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" containerID="3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945" exitCode=0
Sep 08 16:10:53.629946 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.629909    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"
Sep 08 16:10:53.630128 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.629943    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v" event={"ID":"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d","Type":"ContainerDied","Data":"3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945"}
Sep 08 16:10:53.630128 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.629990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v" event={"ID":"3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d","Type":"ContainerDied","Data":"79b97a5ba09f3bd11f7572c6aff5d4bc5ddde025166b8d84d43048b8cc35fd09"}
Sep 08 16:10:53.630128 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.630015    2581 scope.go:117] "RemoveContainer" containerID="3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945"
Sep 08 16:10:53.639733 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.639711    2581 scope.go:117] "RemoveContainer" containerID="3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945"
Sep 08 16:10:53.640063 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:10:53.640045    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945\": container with ID starting with 3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945 not found: ID does not exist" containerID="3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945"
Sep 08 16:10:53.640126 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.640074    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945"} err="failed to get container status \"3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945\": rpc error: code = NotFound desc = could not find container \"3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945\": container with ID starting with 3ffb2b0dc4ffb6a1ce9a6ebe486f6b664b0006ed4c2656bfd00be3b6db745945 not found: ID does not exist"
Sep 08 16:10:53.651379 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.651347    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"]
Sep 08 16:10:53.656512 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:53.656484    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-cf851c/ipp-route-cf851c-kserve-76979c5f8c-5985v"]
Sep 08 16:10:54.365787 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:10:54.365746    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" path="/var/lib/kubelet/pods/3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d/volumes"
Sep 08 16:11:14.869553 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:14.869516    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:15.295296 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:15.295251    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:20.855303 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:20.855268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:20.926026 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:20.925991    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:21.127841 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:21.127727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:21.731790 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:21.731758    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:31.891942 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:31.891903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:31.959115 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:31.959077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:32.064925 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:32.064887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:32.119666 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:32.119633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:32.469464 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:32.469412    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:35.175962 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:35.175924    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:11:36.642006 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:36.641965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:38.279571 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:38.279531    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:38.379927 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:38.379896    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:38.516526 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:38.516489    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"]
Sep 08 16:11:38.516781 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:38.516748    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy" containerID="cri-o://9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91" gracePeriod=30
Sep 08 16:11:38.540171 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:38.540081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:43.776272 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.776242    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:11:43.856082 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.855986    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-data\") pod \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") "
Sep 08 16:11:43.856082 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856045    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-podinfo\") pod \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") "
Sep 08 16:11:43.856082 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856065    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istiod-ca-cert\") pod \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") "
Sep 08 16:11:43.856386 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856106    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-credential-socket\") pod \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") "
Sep 08 16:11:43.856386 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856132    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t94cp\" (UniqueName: \"kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-kube-api-access-t94cp\") pod \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") "
Sep 08 16:11:43.856386 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856175    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-envoy\") pod \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") "
Sep 08 16:11:43.856386 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856221    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-socket\") pod \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") "
Sep 08 16:11:43.856386 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-certs\") pod \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") "
Sep 08 16:11:43.856386 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856289    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-token\") pod \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\" (UID: \"0eb396d4-c829-47a2-addb-39b12b1d7ed6\") "
Sep 08 16:11:43.856712 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856386    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-data" (OuterVolumeSpecName: "istio-data") pod "0eb396d4-c829-47a2-addb-39b12b1d7ed6" (UID: "0eb396d4-c829-47a2-addb-39b12b1d7ed6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:11:43.856712 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856446    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0eb396d4-c829-47a2-addb-39b12b1d7ed6" (UID: "0eb396d4-c829-47a2-addb-39b12b1d7ed6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:11:43.856712 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856565    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0eb396d4-c829-47a2-addb-39b12b1d7ed6" (UID: "0eb396d4-c829-47a2-addb-39b12b1d7ed6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:11:43.856712 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856647    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-data\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:11:43.856712 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856666    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-credential-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:11:43.856712 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856665    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0eb396d4-c829-47a2-addb-39b12b1d7ed6" (UID: "0eb396d4-c829-47a2-addb-39b12b1d7ed6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:11:43.857111 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.856765    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0eb396d4-c829-47a2-addb-39b12b1d7ed6" (UID: "0eb396d4-c829-47a2-addb-39b12b1d7ed6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:11:43.858442 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.858409    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0eb396d4-c829-47a2-addb-39b12b1d7ed6" (UID: "0eb396d4-c829-47a2-addb-39b12b1d7ed6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:11:43.858566 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.858487    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0eb396d4-c829-47a2-addb-39b12b1d7ed6" (UID: "0eb396d4-c829-47a2-addb-39b12b1d7ed6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:11:43.858566 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.858523    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-token" (OuterVolumeSpecName: "istio-token") pod "0eb396d4-c829-47a2-addb-39b12b1d7ed6" (UID: "0eb396d4-c829-47a2-addb-39b12b1d7ed6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:11:43.858566 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.858550    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-kube-api-access-t94cp" (OuterVolumeSpecName: "kube-api-access-t94cp") pod "0eb396d4-c829-47a2-addb-39b12b1d7ed6" (UID: "0eb396d4-c829-47a2-addb-39b12b1d7ed6"). InnerVolumeSpecName "kube-api-access-t94cp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:11:43.927863 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.927797    2581 generic.go:356] "Generic (PLEG): container finished" podID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerID="9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91" exitCode=0
Sep 08 16:11:43.928057 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.927876    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"
Sep 08 16:11:43.928057 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.927894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" event={"ID":"0eb396d4-c829-47a2-addb-39b12b1d7ed6","Type":"ContainerDied","Data":"9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91"}
Sep 08 16:11:43.928057 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.927955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw" event={"ID":"0eb396d4-c829-47a2-addb-39b12b1d7ed6","Type":"ContainerDied","Data":"6cf9881af92f7c68e0502dd98af8d0e845b80141bb107203df661212b647f815"}
Sep 08 16:11:43.928057 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.927986    2581 scope.go:117] "RemoveContainer" containerID="9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91"
Sep 08 16:11:43.937688 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.937666    2581 scope.go:117] "RemoveContainer" containerID="e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe"
Sep 08 16:11:43.947683 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.947655    2581 scope.go:117] "RemoveContainer" containerID="9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91"
Sep 08 16:11:43.948038 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:11:43.948011    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91\": container with ID starting with 9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91 not found: ID does not exist" containerID="9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91"
Sep 08 16:11:43.948145 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.948046    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91"} err="failed to get container status \"9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91\": rpc error: code = NotFound desc = could not find container \"9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91\": container with ID starting with 9ec2cf2210e3035c0b878364c3e53e1e853610b1c7d8e68d9e887e1fa18ced91 not found: ID does not exist"
Sep 08 16:11:43.948145 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.948065    2581 scope.go:117] "RemoveContainer" containerID="e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe"
Sep 08 16:11:43.948362 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:11:43.948344    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe\": container with ID starting with e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe not found: ID does not exist" containerID="e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe"
Sep 08 16:11:43.948404 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.948368    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe"} err="failed to get container status \"e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe\": rpc error: code = NotFound desc = could not find container \"e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe\": container with ID starting with e2330e5e1a4bbb6536098aca43fc4c72888d88ab70f217effd03aeb122b659fe not found: ID does not exist"
Sep 08 16:11:43.949887 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.949862    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"]
Sep 08 16:11:43.953466 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.953439    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-7a7297-openshift-default-65c8dbdbf8-lxgmw"]
Sep 08 16:11:43.957514 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.957495    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-envoy\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:11:43.957576 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.957515    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:11:43.957576 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.957525    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0eb396d4-c829-47a2-addb-39b12b1d7ed6-workload-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:11:43.957576 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.957534    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-token\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:11:43.957576 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.957542    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istio-podinfo\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:11:43.957576 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.957550    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0eb396d4-c829-47a2-addb-39b12b1d7ed6-istiod-ca-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:11:43.957576 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:43.957558    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t94cp\" (UniqueName: \"kubernetes.io/projected/0eb396d4-c829-47a2-addb-39b12b1d7ed6-kube-api-access-t94cp\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:11:44.365942 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:44.365907    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" path="/var/lib/kubelet/pods/0eb396d4-c829-47a2-addb-39b12b1d7ed6/volumes"
Sep 08 16:11:49.344169 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:49.344117    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:49.444700 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:49.444658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:49.511791 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:49.511758    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:49.571438 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:49.571399    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:49.915315 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:49.915260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:52.076957 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:52.076914    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:11:55.957045 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:55.957010    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:56.110134 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:56.110100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:56.205981 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:56.205948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:11:56.583921 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:11:56.583887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:12:06.867586 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:06.867544    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"]
Sep 08 16:12:06.868241 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:06.867790    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn" podUID="cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd" containerName="maas-api" containerID="cri-o://5e1a59ebd0c6f52ceda9650ef1c1ce8829ff1c6d057ee9dc540f0c60d377758a" gracePeriod=30
Sep 08 16:12:06.895251 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:06.895219    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:12:06.955543 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:06.955505    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:12:07.018139 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.018104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:12:07.065795 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.065763    2581 generic.go:356] "Generic (PLEG): container finished" podID="cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd" containerID="5e1a59ebd0c6f52ceda9650ef1c1ce8829ff1c6d057ee9dc540f0c60d377758a" exitCode=0
Sep 08 16:12:07.065979 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.065857    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn" event={"ID":"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd","Type":"ContainerDied","Data":"5e1a59ebd0c6f52ceda9650ef1c1ce8829ff1c6d057ee9dc540f0c60d377758a"}
Sep 08 16:12:07.125942 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.125868    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:12:07.139685 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.139646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:12:07.255555 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.255525    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmstt\" (UniqueName: \"kubernetes.io/projected/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-kube-api-access-vmstt\") pod \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") "
Sep 08 16:12:07.255555 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.255558    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-openshift-service-ca\") pod \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") "
Sep 08 16:12:07.255858 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.255591    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-maas-api-tls\") pod \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") "
Sep 08 16:12:07.255858 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.255667    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-metrics-certs\") pod \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\" (UID: \"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd\") "
Sep 08 16:12:07.256095 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.256044    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd" (UID: "cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:12:07.258296 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.258258    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd" (UID: "cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:12:07.258296 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.258274    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-kube-api-access-vmstt" (OuterVolumeSpecName: "kube-api-access-vmstt") pod "cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd" (UID: "cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd"). InnerVolumeSpecName "kube-api-access-vmstt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:12:07.258675 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.258643    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd" (UID: "cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:12:07.356927 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.356885    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:07.356927 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.356920    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmstt\" (UniqueName: \"kubernetes.io/projected/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-kube-api-access-vmstt\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:07.356927 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.356932    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-openshift-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:07.357166 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.356944    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd-maas-api-tls\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:07.444312 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:07.444278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:12:08.072734 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:08.072703    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"
Sep 08 16:12:08.073232 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:08.072703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn" event={"ID":"cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd","Type":"ContainerDied","Data":"c2532eeb209150d4665f9d754ce37c3cd03c3beb520d8af5be1b03bded197adc"}
Sep 08 16:12:08.073232 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:08.072869    2581 scope.go:117] "RemoveContainer" containerID="5e1a59ebd0c6f52ceda9650ef1c1ce8829ff1c6d057ee9dc540f0c60d377758a"
Sep 08 16:12:08.093971 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:08.093934    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"]
Sep 08 16:12:08.101163 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:08.101113    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a09aa5-677bcc5689-qjfwn"]
Sep 08 16:12:08.366093 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:08.366005    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd" path="/var/lib/kubelet/pods/cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd/volumes"
Sep 08 16:12:09.384349 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:09.384316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:12:13.588937 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:13.588902    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:12:13.648244 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:13.648214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:12:13.831719 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:13.831679    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"]
Sep 08 16:12:13.831960 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:13.831932    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy" containerID="cri-o://2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085" gracePeriod=30
Sep 08 16:12:13.896945 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:13.896905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:12:18.181183 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:18.181140    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:12:19.090157 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.090120    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:12:19.141992 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.141893    2581 generic.go:356] "Generic (PLEG): container finished" podID="b90e93b0-f3c2-4437-b437-c99448a86889" containerID="2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085" exitCode=0
Sep 08 16:12:19.141992 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.141941    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"
Sep 08 16:12:19.141992 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.141970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" event={"ID":"b90e93b0-f3c2-4437-b437-c99448a86889","Type":"ContainerDied","Data":"2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085"}
Sep 08 16:12:19.142225 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.142020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk" event={"ID":"b90e93b0-f3c2-4437-b437-c99448a86889","Type":"ContainerDied","Data":"97e7ad0753e2c69f423d03025dc74c76ea09a4392b0b3f64873e98bb566401df"}
Sep 08 16:12:19.142225 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.142044    2581 scope.go:117] "RemoveContainer" containerID="2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085"
Sep 08 16:12:19.150990 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.150961    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-istio-token\") pod \"b90e93b0-f3c2-4437-b437-c99448a86889\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") "
Sep 08 16:12:19.151158 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.150999    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-socket\") pod \"b90e93b0-f3c2-4437-b437-c99448a86889\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") "
Sep 08 16:12:19.151158 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151031    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-credential-socket\") pod \"b90e93b0-f3c2-4437-b437-c99448a86889\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") "
Sep 08 16:12:19.151158 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151069    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6nkt\" (UniqueName: \"kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-kube-api-access-s6nkt\") pod \"b90e93b0-f3c2-4437-b437-c99448a86889\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") "
Sep 08 16:12:19.151158 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151090    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b90e93b0-f3c2-4437-b437-c99448a86889-istiod-ca-cert\") pod \"b90e93b0-f3c2-4437-b437-c99448a86889\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") "
Sep 08 16:12:19.151158 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151118    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-certs\") pod \"b90e93b0-f3c2-4437-b437-c99448a86889\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") "
Sep 08 16:12:19.151158 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151153    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-data\") pod \"b90e93b0-f3c2-4437-b437-c99448a86889\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") "
Sep 08 16:12:19.151467 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151205    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-envoy\") pod \"b90e93b0-f3c2-4437-b437-c99448a86889\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") "
Sep 08 16:12:19.151467 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151241    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b90e93b0-f3c2-4437-b437-c99448a86889-istio-podinfo\") pod \"b90e93b0-f3c2-4437-b437-c99448a86889\" (UID: \"b90e93b0-f3c2-4437-b437-c99448a86889\") "
Sep 08 16:12:19.151467 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151308    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b90e93b0-f3c2-4437-b437-c99448a86889" (UID: "b90e93b0-f3c2-4437-b437-c99448a86889"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:12:19.151467 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151395    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b90e93b0-f3c2-4437-b437-c99448a86889" (UID: "b90e93b0-f3c2-4437-b437-c99448a86889"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:12:19.151672 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151567    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:19.151672 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151610    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-credential-socket\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:19.151861 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151745    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-data" (OuterVolumeSpecName: "istio-data") pod "b90e93b0-f3c2-4437-b437-c99448a86889" (UID: "b90e93b0-f3c2-4437-b437-c99448a86889"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:12:19.151861 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.151813    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b90e93b0-f3c2-4437-b437-c99448a86889" (UID: "b90e93b0-f3c2-4437-b437-c99448a86889"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:12:19.152054 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.152020    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b90e93b0-f3c2-4437-b437-c99448a86889-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b90e93b0-f3c2-4437-b437-c99448a86889" (UID: "b90e93b0-f3c2-4437-b437-c99448a86889"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:12:19.152157 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.152109    2581 scope.go:117] "RemoveContainer" containerID="719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7"
Sep 08 16:12:19.153625 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.153599    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-kube-api-access-s6nkt" (OuterVolumeSpecName: "kube-api-access-s6nkt") pod "b90e93b0-f3c2-4437-b437-c99448a86889" (UID: "b90e93b0-f3c2-4437-b437-c99448a86889"). InnerVolumeSpecName "kube-api-access-s6nkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:12:19.153723 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.153607    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b90e93b0-f3c2-4437-b437-c99448a86889-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b90e93b0-f3c2-4437-b437-c99448a86889" (UID: "b90e93b0-f3c2-4437-b437-c99448a86889"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:12:19.153723 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.153644    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-istio-token" (OuterVolumeSpecName: "istio-token") pod "b90e93b0-f3c2-4437-b437-c99448a86889" (UID: "b90e93b0-f3c2-4437-b437-c99448a86889"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:12:19.153723 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.153711    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b90e93b0-f3c2-4437-b437-c99448a86889" (UID: "b90e93b0-f3c2-4437-b437-c99448a86889"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:12:19.172420 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.172395    2581 scope.go:117] "RemoveContainer" containerID="2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085"
Sep 08 16:12:19.172759 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:12:19.172734    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085\": container with ID starting with 2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085 not found: ID does not exist" containerID="2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085"
Sep 08 16:12:19.172838 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.172768    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085"} err="failed to get container status \"2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085\": rpc error: code = NotFound desc = could not find container \"2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085\": container with ID starting with 2816fbf086f1dbc46c11f9d468e923a4940437a0a3c8a2eaa185eb87dc8b6085 not found: ID does not exist"
Sep 08 16:12:19.172838 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.172787    2581 scope.go:117] "RemoveContainer" containerID="719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7"
Sep 08 16:12:19.173110 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:12:19.173094    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7\": container with ID starting with 719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7 not found: ID does not exist" containerID="719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7"
Sep 08 16:12:19.173169 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.173114    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7"} err="failed to get container status \"719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7\": rpc error: code = NotFound desc = could not find container \"719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7\": container with ID starting with 719d01b9e93c06bacad4a38de2848d84fdafa72c4dda803dfc969c8823a6c5c7 not found: ID does not exist"
Sep 08 16:12:19.252775 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.252735    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-envoy\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:19.252775 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.252766    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b90e93b0-f3c2-4437-b437-c99448a86889-istio-podinfo\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:19.252775 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.252774    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-istio-token\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:19.252775 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.252785    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6nkt\" (UniqueName: \"kubernetes.io/projected/b90e93b0-f3c2-4437-b437-c99448a86889-kube-api-access-s6nkt\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:19.253285 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.252795    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b90e93b0-f3c2-4437-b437-c99448a86889-istiod-ca-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:19.253285 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.252803    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-workload-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:19.253285 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.252811    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b90e93b0-f3c2-4437-b437-c99448a86889-istio-data\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:12:19.463298 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.463252    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"]
Sep 08 16:12:19.466402 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:19.466372    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a09aa5-openshift-default-55c7f997c6-hccjk"]
Sep 08 16:12:20.365319 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:20.365282    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" path="/var/lib/kubelet/pods/b90e93b0-f3c2-4437-b437-c99448a86889/volumes"
Sep 08 16:12:32.641829 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:32.641794    2581 scope.go:117] "RemoveContainer" containerID="1c21a2fc7966771b1993e0f45ea15d0abe123d0990a1a2d3c9db1bb1ddbe499e"
Sep 08 16:12:38.625673 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:38.625621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:12:38.673891 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:12:38.673856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:13:17.640948 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.640898    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75db7f7669-gcxc4"]
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641288    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae2fcaa5-2966-4e34-a394-c96966e9a878" containerName="maas-api"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641302    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae2fcaa5-2966-4e34-a394-c96966e9a878" containerName="maas-api"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641319    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" containerName="main"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641330    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" containerName="main"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641338    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641344    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641350    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd" containerName="maas-api"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641356    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd" containerName="maas-api"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641365    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641373    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641383    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641388    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641412    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ca0d94-63b5-490e-8aea-1a304b2f0b50" containerName="maas-api"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641418    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ca0d94-63b5-490e-8aea-1a304b2f0b50" containerName="maas-api"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641473    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ca0d94-63b5-490e-8aea-1a304b2f0b50" containerName="maas-api"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641480    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641485    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf185e89-aa2f-45b8-bdcd-3cc74c7de3bd" containerName="maas-api"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641491    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641496    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641501    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3808ec4b-f1c8-46ee-bc0c-5fd13d953a0d" containerName="main"
Sep 08 16:13:17.641497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641506    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b90e93b0-f3c2-4437-b437-c99448a86889" containerName="istio-proxy"
Sep 08 16:13:17.642205 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.641512    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae2fcaa5-2966-4e34-a394-c96966e9a878" containerName="maas-api"
Sep 08 16:13:17.644549 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.644532    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:17.647470 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.647438    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 16:13:17.647643 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.647621    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 16:13:17.647731 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.647657    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 16:13:17.647731 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.647662    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4tklt\""
Sep 08 16:13:17.654568 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.654540    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75db7f7669-gcxc4"]
Sep 08 16:13:17.666665 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.666635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-metrics-certs\") pod \"maas-controller-75db7f7669-gcxc4\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") " pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:17.666879 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.666679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-webhook-cert\") pod \"maas-controller-75db7f7669-gcxc4\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") " pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:17.666879 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.666717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxcnx\" (UniqueName: \"kubernetes.io/projected/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-kube-api-access-cxcnx\") pod \"maas-controller-75db7f7669-gcxc4\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") " pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:17.767163 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.767123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-metrics-certs\") pod \"maas-controller-75db7f7669-gcxc4\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") " pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:17.767163 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.767171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-webhook-cert\") pod \"maas-controller-75db7f7669-gcxc4\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") " pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:17.767402 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.767195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxcnx\" (UniqueName: \"kubernetes.io/projected/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-kube-api-access-cxcnx\") pod \"maas-controller-75db7f7669-gcxc4\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") " pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:17.769690 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.769655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-metrics-certs\") pod \"maas-controller-75db7f7669-gcxc4\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") " pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:17.769690 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.769673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-webhook-cert\") pod \"maas-controller-75db7f7669-gcxc4\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") " pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:17.775222 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.775199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxcnx\" (UniqueName: \"kubernetes.io/projected/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-kube-api-access-cxcnx\") pod \"maas-controller-75db7f7669-gcxc4\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") " pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:17.955588 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:17.955536    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:18.233956 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:18.233927    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75db7f7669-gcxc4"]
Sep 08 16:13:18.234849 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:13:18.234808    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734a50ac_3d83_4cf6_bf5d_ae9c387b7e65.slice/crio-52a80ed6fcefdd32738e14c90f0869898b717ee14cbbb7e4669a5da3cc716911 WatchSource:0}: Error finding container 52a80ed6fcefdd32738e14c90f0869898b717ee14cbbb7e4669a5da3cc716911: Status 404 returned error can't find the container with id 52a80ed6fcefdd32738e14c90f0869898b717ee14cbbb7e4669a5da3cc716911
Sep 08 16:13:18.236425 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:18.236400    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:13:18.486327 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:18.486231    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75db7f7669-gcxc4" event={"ID":"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65","Type":"ContainerStarted","Data":"52a80ed6fcefdd32738e14c90f0869898b717ee14cbbb7e4669a5da3cc716911"}
Sep 08 16:13:20.499490 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:20.499457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75db7f7669-gcxc4" event={"ID":"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65","Type":"ContainerStarted","Data":"206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b"}
Sep 08 16:13:20.500001 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:20.499575    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:20.517770 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:20.517680    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75db7f7669-gcxc4" podStartSLOduration=1.809613327 podStartE2EDuration="3.517655483s" totalImagesPullingTime="1.708042156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:13:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:13:20.515965347 +0000 UTC m=+1728.638120961" watchObservedRunningTime="2026-09-08 16:13:20.517655483 +0000 UTC m=+1728.639811100"
Sep 08 16:13:24.760411 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:24.760375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:13:31.507805 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:31.507775    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:39.561674 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:39.561635    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:13:40.473546 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:40.473504    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:13:40.692262 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:40.692224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:13:40.786604 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:40.786508    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75db7f7669-gcxc4"]
Sep 08 16:13:40.786843 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:40.786801    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75db7f7669-gcxc4" podUID="734a50ac-3d83-4cf6-bf5d-ae9c387b7e65" containerName="manager" containerID="cri-o://206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b" gracePeriod=30
Sep 08 16:13:41.031271 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.031245    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:41.182674 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.182638    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxcnx\" (UniqueName: \"kubernetes.io/projected/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-kube-api-access-cxcnx\") pod \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") "
Sep 08 16:13:41.182885 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.182700    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-webhook-cert\") pod \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") "
Sep 08 16:13:41.182885 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.182740    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-metrics-certs\") pod \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\" (UID: \"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65\") "
Sep 08 16:13:41.184869 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.184830    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "734a50ac-3d83-4cf6-bf5d-ae9c387b7e65" (UID: "734a50ac-3d83-4cf6-bf5d-ae9c387b7e65"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:13:41.184869 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.184870    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "734a50ac-3d83-4cf6-bf5d-ae9c387b7e65" (UID: "734a50ac-3d83-4cf6-bf5d-ae9c387b7e65"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:13:41.185045 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.184941    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-kube-api-access-cxcnx" (OuterVolumeSpecName: "kube-api-access-cxcnx") pod "734a50ac-3d83-4cf6-bf5d-ae9c387b7e65" (UID: "734a50ac-3d83-4cf6-bf5d-ae9c387b7e65"). InnerVolumeSpecName "kube-api-access-cxcnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:13:41.283411 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.283364    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-webhook-cert\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:13:41.283411 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.283402    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:13:41.283411 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.283411    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxcnx\" (UniqueName: \"kubernetes.io/projected/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65-kube-api-access-cxcnx\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:13:41.616256 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.616168    2581 generic.go:356] "Generic (PLEG): container finished" podID="734a50ac-3d83-4cf6-bf5d-ae9c387b7e65" containerID="206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b" exitCode=0
Sep 08 16:13:41.616256 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.616219    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75db7f7669-gcxc4"
Sep 08 16:13:41.616474 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.616265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75db7f7669-gcxc4" event={"ID":"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65","Type":"ContainerDied","Data":"206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b"}
Sep 08 16:13:41.616474 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.616325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75db7f7669-gcxc4" event={"ID":"734a50ac-3d83-4cf6-bf5d-ae9c387b7e65","Type":"ContainerDied","Data":"52a80ed6fcefdd32738e14c90f0869898b717ee14cbbb7e4669a5da3cc716911"}
Sep 08 16:13:41.616474 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.616351    2581 scope.go:117] "RemoveContainer" containerID="206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b"
Sep 08 16:13:41.628985 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.628961    2581 scope.go:117] "RemoveContainer" containerID="206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b"
Sep 08 16:13:41.629296 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:13:41.629275    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b\": container with ID starting with 206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b not found: ID does not exist" containerID="206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b"
Sep 08 16:13:41.629351 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.629318    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b"} err="failed to get container status \"206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b\": rpc error: code = NotFound desc = could not find container \"206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b\": container with ID starting with 206e7ab030f03710231d272cd76de17f2b150595f3766ec8bcb22857efb34d2b not found: ID does not exist"
Sep 08 16:13:41.637914 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.637886    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75db7f7669-gcxc4"]
Sep 08 16:13:41.642898 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:41.642872    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75db7f7669-gcxc4"]
Sep 08 16:13:42.260737 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.260703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:13:42.365577 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.365541    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="734a50ac-3d83-4cf6-bf5d-ae9c387b7e65" path="/var/lib/kubelet/pods/734a50ac-3d83-4cf6-bf5d-ae9c387b7e65/volumes"
Sep 08 16:13:42.372250 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.372219    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75db7f7669-ghcn8"]
Sep 08 16:13:42.372567 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.372554    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy"
Sep 08 16:13:42.372621 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.372567    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb396d4-c829-47a2-addb-39b12b1d7ed6" containerName="istio-proxy"
Sep 08 16:13:42.372621 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.372592    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="734a50ac-3d83-4cf6-bf5d-ae9c387b7e65" containerName="manager"
Sep 08 16:13:42.372621 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.372598    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="734a50ac-3d83-4cf6-bf5d-ae9c387b7e65" containerName="manager"
Sep 08 16:13:42.372720 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.372650    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="734a50ac-3d83-4cf6-bf5d-ae9c387b7e65" containerName="manager"
Sep 08 16:13:42.376941 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.376922    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.379831 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.379791    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 16:13:42.379981 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.379815    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 16:13:42.379981 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.379933    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 16:13:42.379981 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.379933    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4tklt\""
Sep 08 16:13:42.385266 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.385243    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75db7f7669-ghcn8"]
Sep 08 16:13:42.494402 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.494365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/068dee49-1efa-4f9d-b788-9de8156065da-webhook-cert\") pod \"maas-controller-75db7f7669-ghcn8\" (UID: \"068dee49-1efa-4f9d-b788-9de8156065da\") " pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.494598 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.494412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068dee49-1efa-4f9d-b788-9de8156065da-metrics-certs\") pod \"maas-controller-75db7f7669-ghcn8\" (UID: \"068dee49-1efa-4f9d-b788-9de8156065da\") " pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.494598 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.494492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9brnj\" (UniqueName: \"kubernetes.io/projected/068dee49-1efa-4f9d-b788-9de8156065da-kube-api-access-9brnj\") pod \"maas-controller-75db7f7669-ghcn8\" (UID: \"068dee49-1efa-4f9d-b788-9de8156065da\") " pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.595233 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.595150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9brnj\" (UniqueName: \"kubernetes.io/projected/068dee49-1efa-4f9d-b788-9de8156065da-kube-api-access-9brnj\") pod \"maas-controller-75db7f7669-ghcn8\" (UID: \"068dee49-1efa-4f9d-b788-9de8156065da\") " pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.595233 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.595229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/068dee49-1efa-4f9d-b788-9de8156065da-webhook-cert\") pod \"maas-controller-75db7f7669-ghcn8\" (UID: \"068dee49-1efa-4f9d-b788-9de8156065da\") " pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.595516 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.595272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068dee49-1efa-4f9d-b788-9de8156065da-metrics-certs\") pod \"maas-controller-75db7f7669-ghcn8\" (UID: \"068dee49-1efa-4f9d-b788-9de8156065da\") " pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.597775 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.597752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/068dee49-1efa-4f9d-b788-9de8156065da-webhook-cert\") pod \"maas-controller-75db7f7669-ghcn8\" (UID: \"068dee49-1efa-4f9d-b788-9de8156065da\") " pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.597928 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.597773    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068dee49-1efa-4f9d-b788-9de8156065da-metrics-certs\") pod \"maas-controller-75db7f7669-ghcn8\" (UID: \"068dee49-1efa-4f9d-b788-9de8156065da\") " pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.603136 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.603104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9brnj\" (UniqueName: \"kubernetes.io/projected/068dee49-1efa-4f9d-b788-9de8156065da-kube-api-access-9brnj\") pod \"maas-controller-75db7f7669-ghcn8\" (UID: \"068dee49-1efa-4f9d-b788-9de8156065da\") " pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.688297 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.688263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:42.964694 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:42.964654    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75db7f7669-ghcn8"]
Sep 08 16:13:42.966246 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:13:42.966217    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068dee49_1efa_4f9d_b788_9de8156065da.slice/crio-49eb50b631149de31104b9bac8097fdc87ee735ae0bbc463860b1cc4f8470f22 WatchSource:0}: Error finding container 49eb50b631149de31104b9bac8097fdc87ee735ae0bbc463860b1cc4f8470f22: Status 404 returned error can't find the container with id 49eb50b631149de31104b9bac8097fdc87ee735ae0bbc463860b1cc4f8470f22
Sep 08 16:13:43.629295 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:43.629256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75db7f7669-ghcn8" event={"ID":"068dee49-1efa-4f9d-b788-9de8156065da","Type":"ContainerStarted","Data":"49eb50b631149de31104b9bac8097fdc87ee735ae0bbc463860b1cc4f8470f22"}
Sep 08 16:13:44.636689 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:44.636650    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75db7f7669-ghcn8" event={"ID":"068dee49-1efa-4f9d-b788-9de8156065da","Type":"ContainerStarted","Data":"71d90f816742e3c96be771ae88b72a1f504cbee274c9cac520cd8f910e87d397"}
Sep 08 16:13:44.637121 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:44.636716    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:13:44.655669 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:44.655609    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75db7f7669-ghcn8" podStartSLOduration=1.719205892 podStartE2EDuration="2.655590622s" totalImagesPullingTime="936.38473ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:13:44.653816507 +0000 UTC m=+1752.775972123" watchObservedRunningTime="2026-09-08 16:13:44.655590622 +0000 UTC m=+1752.777746237"
Sep 08 16:13:55.646210 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:13:55.646175    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75db7f7669-ghcn8"
Sep 08 16:14:07.579660 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:14:07.579625    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:14:15.281236 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:14:15.281196    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:14:17.285717 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:14:17.285667    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:14:23.638119 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:14:23.638080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:14:41.281080 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:14:41.281041    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:16:10.485126 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:16:10.485030    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:16:17.495475 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:16:17.495437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:16:25.908189 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:16:25.908148    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:16:27.683848 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:16:27.683796    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:16:36.296399 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:16:36.296364    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:16:38.780846 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:16:38.780783    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:17:01.850350 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:01.850316    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:17:03.276735 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:03.276687    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:17:03.884701 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:03.884661    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:17:13.079676 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:13.079628    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:17:20.284129 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:20.284080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:17:26.279311 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:26.279229    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:17:34.192386 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.192342    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"]
Sep 08 16:17:34.196062 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.196037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:17:34.196201 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.196146    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.198242 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.198218    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vmx7t\""
Sep 08 16:17:34.206393 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.206361    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"]
Sep 08 16:17:34.207981 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.207953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e43e9c-a671-48f4-8b9c-97b45df29037-metrics-certs\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.208100 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.208068    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e43e9c-a671-48f4-8b9c-97b45df29037-openshift-service-ca\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.208144 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.208098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5stqm\" (UniqueName: \"kubernetes.io/projected/d5e43e9c-a671-48f4-8b9c-97b45df29037-kube-api-access-5stqm\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.208199 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.208151    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5e43e9c-a671-48f4-8b9c-97b45df29037-maas-api-tls\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.309671 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.309636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e43e9c-a671-48f4-8b9c-97b45df29037-openshift-service-ca\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.309671 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.309673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5stqm\" (UniqueName: \"kubernetes.io/projected/d5e43e9c-a671-48f4-8b9c-97b45df29037-kube-api-access-5stqm\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.309991 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.309710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5e43e9c-a671-48f4-8b9c-97b45df29037-maas-api-tls\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.309991 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.309739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e43e9c-a671-48f4-8b9c-97b45df29037-metrics-certs\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.310424 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.310397    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e43e9c-a671-48f4-8b9c-97b45df29037-openshift-service-ca\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.312354 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.312331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e43e9c-a671-48f4-8b9c-97b45df29037-metrics-certs\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.312440 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.312380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5e43e9c-a671-48f4-8b9c-97b45df29037-maas-api-tls\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.317893 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.317868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5stqm\" (UniqueName: \"kubernetes.io/projected/d5e43e9c-a671-48f4-8b9c-97b45df29037-kube-api-access-5stqm\") pod \"maas-api-5b5cf869c4-w8jn7\" (UID: \"d5e43e9c-a671-48f4-8b9c-97b45df29037\") " pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.508748 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.508651    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:34.782325 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.782291    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"]
Sep 08 16:17:34.783876 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:17:34.783846    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e43e9c_a671_48f4_8b9c_97b45df29037.slice/crio-355d5a21dea0cd54a792c464c32a481201a1ae97e0929b0833c1585aa19d3f4f WatchSource:0}: Error finding container 355d5a21dea0cd54a792c464c32a481201a1ae97e0929b0833c1585aa19d3f4f: Status 404 returned error can't find the container with id 355d5a21dea0cd54a792c464c32a481201a1ae97e0929b0833c1585aa19d3f4f
Sep 08 16:17:34.914698 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:34.914664    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7" event={"ID":"d5e43e9c-a671-48f4-8b9c-97b45df29037","Type":"ContainerStarted","Data":"355d5a21dea0cd54a792c464c32a481201a1ae97e0929b0833c1585aa19d3f4f"}
Sep 08 16:17:35.922093 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:35.922052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7" event={"ID":"d5e43e9c-a671-48f4-8b9c-97b45df29037","Type":"ContainerStarted","Data":"7b04226cedc7523ceb1bf6911088c4d69db90e0bfa08472c1447d551fa48f6e4"}
Sep 08 16:17:35.922488 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:35.922121    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:35.939454 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:35.939397    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7" podStartSLOduration=1.366979539 podStartE2EDuration="1.939379523s" totalImagesPullingTime="572.399984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:17:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:17:35.937791844 +0000 UTC m=+1984.059947460" watchObservedRunningTime="2026-09-08 16:17:35.939379523 +0000 UTC m=+1984.061535172"
Sep 08 16:17:41.278812 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:41.278769    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:17:41.932284 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:41.932249    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5b5cf869c4-w8jn7"
Sep 08 16:17:41.976643 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:41.976607    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"]
Sep 08 16:17:41.976941 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:41.976876    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw" podUID="2d6c027c-9e63-4c5c-bbab-2ef8fd84f466" containerName="maas-api" containerID="cri-o://1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84" gracePeriod=30
Sep 08 16:17:43.226649 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.226617    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 16:17:43.287122 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.287074    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-openshift-service-ca\") pod \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") "
Sep 08 16:17:43.287122 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.287121    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhv44\" (UniqueName: \"kubernetes.io/projected/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-kube-api-access-jhv44\") pod \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") "
Sep 08 16:17:43.287392 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.287141    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-maas-api-tls\") pod \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") "
Sep 08 16:17:43.287392 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.287221    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-metrics-certs\") pod \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\" (UID: \"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466\") "
Sep 08 16:17:43.287590 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.287534    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2d6c027c-9e63-4c5c-bbab-2ef8fd84f466" (UID: "2d6c027c-9e63-4c5c-bbab-2ef8fd84f466"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:17:43.289309 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.289284    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2d6c027c-9e63-4c5c-bbab-2ef8fd84f466" (UID: "2d6c027c-9e63-4c5c-bbab-2ef8fd84f466"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:17:43.289309 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.289292    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-kube-api-access-jhv44" (OuterVolumeSpecName: "kube-api-access-jhv44") pod "2d6c027c-9e63-4c5c-bbab-2ef8fd84f466" (UID: "2d6c027c-9e63-4c5c-bbab-2ef8fd84f466"). InnerVolumeSpecName "kube-api-access-jhv44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:17:43.289421 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.289383    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2d6c027c-9e63-4c5c-bbab-2ef8fd84f466" (UID: "2d6c027c-9e63-4c5c-bbab-2ef8fd84f466"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:17:43.394269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.388481    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-metrics-certs\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:17:43.394269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.388532    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-openshift-service-ca\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:17:43.394269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.388560    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhv44\" (UniqueName: \"kubernetes.io/projected/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-kube-api-access-jhv44\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:17:43.394269 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.388576    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466-maas-api-tls\") on node \"ip-10-0-143-238.ec2.internal\" DevicePath \"\""
Sep 08 16:17:43.965869 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.965805    2581 generic.go:356] "Generic (PLEG): container finished" podID="2d6c027c-9e63-4c5c-bbab-2ef8fd84f466" containerID="1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84" exitCode=0
Sep 08 16:17:43.966104 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.965885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw" event={"ID":"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466","Type":"ContainerDied","Data":"1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84"}
Sep 08 16:17:43.966104 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.965896    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"
Sep 08 16:17:43.966104 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.965977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw" event={"ID":"2d6c027c-9e63-4c5c-bbab-2ef8fd84f466","Type":"ContainerDied","Data":"ede9803353c9f7f53f8baf6795da6fcc5d81c27917cc591b7e3a4a4d41c4dea4"}
Sep 08 16:17:43.966104 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.966010    2581 scope.go:117] "RemoveContainer" containerID="1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84"
Sep 08 16:17:43.975784 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.975764    2581 scope.go:117] "RemoveContainer" containerID="1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84"
Sep 08 16:17:43.976151 ip-10-0-143-238 kubenswrapper[2581]: E0908 16:17:43.976128    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84\": container with ID starting with 1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84 not found: ID does not exist" containerID="1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84"
Sep 08 16:17:43.976202 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.976163    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84"} err="failed to get container status \"1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84\": rpc error: code = NotFound desc = could not find container \"1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84\": container with ID starting with 1837ccd8385e7450013ff3ab5222aab00d03005771516829cae75766979acf84 not found: ID does not exist"
Sep 08 16:17:43.987015 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.986983    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"]
Sep 08 16:17:43.990813 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:43.990780    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff8b9db6-dhknw"]
Sep 08 16:17:44.366529 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:44.366433    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d6c027c-9e63-4c5c-bbab-2ef8fd84f466" path="/var/lib/kubelet/pods/2d6c027c-9e63-4c5c-bbab-2ef8fd84f466/volumes"
Sep 08 16:17:46.976097 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:46.976057    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:17:49.182199 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:49.182167    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:17:53.982308 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:17:53.982267    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jg79l"]
Sep 08 16:18:01.857502 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:01.857469    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g42hv_0361c5f8-c510-4f69-a963-248bde9b863b/manager/0.log"
Sep 08 16:18:01.993145 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:01.993114    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ph22l_f5023456-979a-4b89-8e1e-f61c5c638c51/manager/0.log"
Sep 08 16:18:02.111214 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:02.111104    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75db7f7669-ghcn8_068dee49-1efa-4f9d-b788-9de8156065da/manager/0.log"
Sep 08 16:18:02.703331 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:02.703299    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4b5866d6-s57fx_eeb46ad6-dc65-47cc-a6e6-495613684200/copy-manifests/0.log"
Sep 08 16:18:02.709445 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:02.709418    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4b5866d6-s57fx_eeb46ad6-dc65-47cc-a6e6-495613684200/manager/0.log"
Sep 08 16:18:03.162835 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:03.162804    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5b5cf869c4-w8jn7_d5e43e9c-a671-48f4-8b9c-97b45df29037/maas-api/0.log"
Sep 08 16:18:03.482442 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:03.482352    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-pvqh9_96dae3c4-faa0-4293-9341-df83833eb2cb/postgres/0.log"
Sep 08 16:18:04.824382 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:04.824352    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-jg79l_fbd47961-5163-4de8-b6a8-5f5677f7d2cb/limitador/0.log"
Sep 08 16:18:04.939184 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:04.939129    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-v9vsg_d4a66208-3a4f-4393-909d-48a9bc1419e0/manager/0.log"
Sep 08 16:18:05.404205 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:05.404163    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fd2nk_381ee37a-a63e-4e9a-854e-a32361d39d1f/discovery/0.log"
Sep 08 16:18:05.634335 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:05.634298    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bfc7b5fc-dtvk5_3509c93b-346f-4e53-a0b4-b36b93627589/kube-auth-proxy/0.log"
Sep 08 16:18:06.462344 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:06.462312    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9vm6f_f706cda6-316f-448b-9f3f-e8bea71c55ff/main/0.log"
Sep 08 16:18:06.817116 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:06.817034    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2pzk7_3a2ab52b-821a-425d-a676-ba82a6a08166/main/0.log"
Sep 08 16:18:12.389855 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:12.389805    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:18:12.457815 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:12.457767    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log" limit=1024
Sep 08 16:18:15.951296 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:15.951260    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q5jph_ec19266e-6f33-48f8-a4fd-f09a750a0e57/global-pull-secret-syncer/0.log"
Sep 08 16:18:16.074095 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:16.074061    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gr864_94657cce-2a40-4616-a505-beb24b11159d/konnectivity-agent/0.log"
Sep 08 16:18:16.198492 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:16.198458    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-238.ec2.internal_acc58ec07b60ea490ac16da8d8db6186/haproxy/0.log"
Sep 08 16:18:20.998802 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:20.998771    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-jg79l_fbd47961-5163-4de8-b6a8-5f5677f7d2cb/limitador/0.log"
Sep 08 16:18:21.047497 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:21.047457    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-v9vsg_d4a66208-3a4f-4393-909d-48a9bc1419e0/manager/0.log"
Sep 08 16:18:22.658338 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:22.658308    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c52d4eb8-5064-4c04-8d52-dbc9aa9752c7/alertmanager/0.log"
Sep 08 16:18:22.679408 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:22.679381    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c52d4eb8-5064-4c04-8d52-dbc9aa9752c7/config-reloader/0.log"
Sep 08 16:18:22.697609 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:22.697578    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c52d4eb8-5064-4c04-8d52-dbc9aa9752c7/kube-rbac-proxy-web/0.log"
Sep 08 16:18:22.717317 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:22.717292    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c52d4eb8-5064-4c04-8d52-dbc9aa9752c7/kube-rbac-proxy/0.log"
Sep 08 16:18:22.739088 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:22.739064    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c52d4eb8-5064-4c04-8d52-dbc9aa9752c7/kube-rbac-proxy-metric/0.log"
Sep 08 16:18:22.761780 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:22.761754    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c52d4eb8-5064-4c04-8d52-dbc9aa9752c7/prom-label-proxy/0.log"
Sep 08 16:18:22.781938 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:22.781902    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c52d4eb8-5064-4c04-8d52-dbc9aa9752c7/init-config-reloader/0.log"
Sep 08 16:18:22.943424 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:22.943340    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-9jh7m_a43a9f40-b6b1-4129-99cf-512a49d89f18/monitoring-plugin/0.log"
Sep 08 16:18:22.969393 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:22.969364    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64cjp_e1abe2c1-acce-4f8c-887d-d3475e3f76c4/node-exporter/0.log"
Sep 08 16:18:22.990243 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:22.990208    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64cjp_e1abe2c1-acce-4f8c-887d-d3475e3f76c4/kube-rbac-proxy/0.log"
Sep 08 16:18:23.009354 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:23.009291    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64cjp_e1abe2c1-acce-4f8c-887d-d3475e3f76c4/init-textfile/0.log"
Sep 08 16:18:23.478681 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:23.478651    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-2ls7n_a82a84d3-cccf-4946-8a76-7c7cae5983de/prometheus-operator-admission-webhook/0.log"
Sep 08 16:18:23.512316 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:23.512295    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-878599bf-bjzww_9297b984-89e9-49e4-ac85-fbf0aecf71fd/telemeter-client/0.log"
Sep 08 16:18:23.541416 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:23.541386    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-878599bf-bjzww_9297b984-89e9-49e4-ac85-fbf0aecf71fd/reload/0.log"
Sep 08 16:18:23.562508 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:23.562477    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-878599bf-bjzww_9297b984-89e9-49e4-ac85-fbf0aecf71fd/kube-rbac-proxy/0.log"
Sep 08 16:18:26.617023 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.616981    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"]
Sep 08 16:18:26.617418 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.617396    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d6c027c-9e63-4c5c-bbab-2ef8fd84f466" containerName="maas-api"
Sep 08 16:18:26.617418 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.617408    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d6c027c-9e63-4c5c-bbab-2ef8fd84f466" containerName="maas-api"
Sep 08 16:18:26.617498 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.617479    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d6c027c-9e63-4c5c-bbab-2ef8fd84f466" containerName="maas-api"
Sep 08 16:18:26.621070 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.621045    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.622985 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.622954    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jllsk\"/\"kube-root-ca.crt\""
Sep 08 16:18:26.623139 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.623091    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jllsk\"/\"openshift-service-ca.crt\""
Sep 08 16:18:26.623661 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.623645    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jllsk\"/\"default-dockercfg-m9wgw\""
Sep 08 16:18:26.631790 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.631756    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"]
Sep 08 16:18:26.674659 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.674615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-sys\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.674659 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.674663    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-proc\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.674937 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.674692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddjn7\" (UniqueName: \"kubernetes.io/projected/41838593-f5fd-4a6c-b2db-890370dcc957-kube-api-access-ddjn7\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.674937 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.674727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-podres\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.674937 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.674753    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-lib-modules\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.776079 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.776029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-proc\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.776283 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.776094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddjn7\" (UniqueName: \"kubernetes.io/projected/41838593-f5fd-4a6c-b2db-890370dcc957-kube-api-access-ddjn7\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.776283 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.776118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-podres\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.776283 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.776146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-lib-modules\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.776283 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.776161    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-proc\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.776283 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.776240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-sys\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.776283 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.776286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-lib-modules\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.776519 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.776296    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-podres\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.776519 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.776350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41838593-f5fd-4a6c-b2db-890370dcc957-sys\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.785198 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.785171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddjn7\" (UniqueName: \"kubernetes.io/projected/41838593-f5fd-4a6c-b2db-890370dcc957-kube-api-access-ddjn7\") pod \"perf-node-gather-daemonset-9c7wr\" (UID: \"41838593-f5fd-4a6c-b2db-890370dcc957\") " pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:26.931256 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:26.931214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:27.205488 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:27.205453    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"]
Sep 08 16:18:27.207304 ip-10-0-143-238 kubenswrapper[2581]: W0908 16:18:27.207278    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod41838593_f5fd_4a6c_b2db_890370dcc957.slice/crio-9fa599a028646399cb7aeec7f700a9ae2a8a9a1dc5b64ea2038d46793b00954c WatchSource:0}: Error finding container 9fa599a028646399cb7aeec7f700a9ae2a8a9a1dc5b64ea2038d46793b00954c: Status 404 returned error can't find the container with id 9fa599a028646399cb7aeec7f700a9ae2a8a9a1dc5b64ea2038d46793b00954c
Sep 08 16:18:27.215707 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:27.215667    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr" event={"ID":"41838593-f5fd-4a6c-b2db-890370dcc957","Type":"ContainerStarted","Data":"9fa599a028646399cb7aeec7f700a9ae2a8a9a1dc5b64ea2038d46793b00954c"}
Sep 08 16:18:28.010491 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:28.010452    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-89ltc_b9c9745d-ab52-4f00-a408-0441edbdf049/dns/0.log"
Sep 08 16:18:28.028044 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:28.028011    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-89ltc_b9c9745d-ab52-4f00-a408-0441edbdf049/kube-rbac-proxy/0.log"
Sep 08 16:18:28.085659 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:28.085626    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8mfgw_6e5777e7-673f-433b-8801-c987cdb4b1b8/dns-node-resolver/0.log"
Sep 08 16:18:28.223242 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:28.223207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr" event={"ID":"41838593-f5fd-4a6c-b2db-890370dcc957","Type":"ContainerStarted","Data":"516b09b5b6a0b164a836c5a0b0388da802cb3ff077eca1bee723cb26b5db699d"}
Sep 08 16:18:28.223422 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:28.223312    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:28.240348 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:28.240290    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr" podStartSLOduration=2.240270285 podStartE2EDuration="2.240270285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:18:28.238408509 +0000 UTC m=+2036.360564124" watchObservedRunningTime="2026-09-08 16:18:28.240270285 +0000 UTC m=+2036.362425900"
Sep 08 16:18:28.600420 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:28.600380    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7db6ffdfbf-4wzpm_9f48b7c4-3a57-4c95-8401-b9d62b4bdf42/registry/0.log"
Sep 08 16:18:28.657711 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:28.657675    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vnv7m_58f3e0d6-9b77-4370-b753-d9fe5fe6769d/node-ca/0.log"
Sep 08 16:18:29.770563 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:29.770526    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fd2nk_381ee37a-a63e-4e9a-854e-a32361d39d1f/discovery/0.log"
Sep 08 16:18:29.810263 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:29.810235    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bfc7b5fc-dtvk5_3509c93b-346f-4e53-a0b4-b36b93627589/kube-auth-proxy/0.log"
Sep 08 16:18:30.830091 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:30.830046    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kkv8k_e5242e48-8452-44ce-99c0-d72cf7485389/serve-healthcheck-canary/0.log"
Sep 08 16:18:31.287950 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:31.287923    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6h9df_7d2949f2-6be5-4492-a713-0a9a3e1b851b/kube-rbac-proxy/0.log"
Sep 08 16:18:31.306834 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:31.306805    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6h9df_7d2949f2-6be5-4492-a713-0a9a3e1b851b/exporter/0.log"
Sep 08 16:18:31.327084 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:31.327050    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6h9df_7d2949f2-6be5-4492-a713-0a9a3e1b851b/extractor/0.log"
Sep 08 16:18:33.435604 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:33.435565    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g42hv_0361c5f8-c510-4f69-a963-248bde9b863b/manager/0.log"
Sep 08 16:18:33.611980 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:33.611950    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ph22l_f5023456-979a-4b89-8e1e-f61c5c638c51/manager/0.log"
Sep 08 16:18:33.653395 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:33.653359    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75db7f7669-ghcn8_068dee49-1efa-4f9d-b788-9de8156065da/manager/0.log"
Sep 08 16:18:34.003712 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:34.003674    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4b5866d6-s57fx_eeb46ad6-dc65-47cc-a6e6-495613684200/manager/0.log"
Sep 08 16:18:34.024426 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:34.024400    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4b5866d6-s57fx_eeb46ad6-dc65-47cc-a6e6-495613684200/copy-manifests/0.log"
Sep 08 16:18:34.239059 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:34.239029    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jllsk/perf-node-gather-daemonset-9c7wr"
Sep 08 16:18:36.111280 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:36.111188    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fd2nk_381ee37a-a63e-4e9a-854e-a32361d39d1f/discovery/0.log"
Sep 08 16:18:36.140508 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:36.140468    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bfc7b5fc-dtvk5_3509c93b-346f-4e53-a0b4-b36b93627589/kube-auth-proxy/0.log"
Sep 08 16:18:38.027374 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:38.027284    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fd2nk_381ee37a-a63e-4e9a-854e-a32361d39d1f/discovery/0.log"
Sep 08 16:18:38.060449 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:38.060414    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bfc7b5fc-dtvk5_3509c93b-346f-4e53-a0b4-b36b93627589/kube-auth-proxy/0.log"
Sep 08 16:18:41.517694 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:41.517661    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b47kh_d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7/kube-multus-additional-cni-plugins/0.log"
Sep 08 16:18:41.538082 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:41.538050    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b47kh_d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7/egress-router-binary-copy/0.log"
Sep 08 16:18:41.555736 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:41.555712    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b47kh_d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7/cni-plugins/0.log"
Sep 08 16:18:41.573661 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:41.573634    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b47kh_d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7/bond-cni-plugin/0.log"
Sep 08 16:18:41.592031 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:41.592005    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b47kh_d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7/routeoverride-cni/0.log"
Sep 08 16:18:41.611887 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:41.611848    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b47kh_d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7/whereabouts-cni-bincopy/0.log"
Sep 08 16:18:41.630529 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:41.630501    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b47kh_d67fc07f-ff1d-4865-84d8-67b1a0cc2fa7/whereabouts-cni/0.log"
Sep 08 16:18:41.974248 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:41.974214    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rsff8_f4d487fe-c0f8-427a-8ed1-66d412972925/kube-multus/0.log"
Sep 08 16:18:42.117952 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:42.117919    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tk7z8_7f248c91-519f-4278-a822-ed12fcee59d0/network-metrics-daemon/0.log"
Sep 08 16:18:42.133531 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:42.133499    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tk7z8_7f248c91-519f-4278-a822-ed12fcee59d0/kube-rbac-proxy/0.log"
Sep 08 16:18:43.128140 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:43.128112    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt496_bf33e832-454f-4983-828c-059875e55c08/ovn-controller/0.log"
Sep 08 16:18:43.147135 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:43.147106    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt496_bf33e832-454f-4983-828c-059875e55c08/ovn-acl-logging/0.log"
Sep 08 16:18:43.166474 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:43.166445    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt496_bf33e832-454f-4983-828c-059875e55c08/kube-rbac-proxy-node/0.log"
Sep 08 16:18:43.190376 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:43.190342    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt496_bf33e832-454f-4983-828c-059875e55c08/kube-rbac-proxy-ovn-metrics/0.log"
Sep 08 16:18:43.207347 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:43.207313    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt496_bf33e832-454f-4983-828c-059875e55c08/northd/0.log"
Sep 08 16:18:43.225936 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:43.225907    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt496_bf33e832-454f-4983-828c-059875e55c08/nbdb/0.log"
Sep 08 16:18:43.243230 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:43.243202    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt496_bf33e832-454f-4983-828c-059875e55c08/sbdb/0.log"
Sep 08 16:18:43.297722 ip-10-0-143-238 kubenswrapper[2581]: I0908 16:18:43.297695    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt496_bf33e832-454f-4983-828c-059875e55c08/ovnkube-controller/0.log"