Sep 09 23:48:45.761226 ip-10-0-128-118 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 23:48:46.129895 ip-10-0-128-118 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:48:46.129895 ip-10-0-128-118 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 23:48:46.129895 ip-10-0-128-118 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:48:46.129895 ip-10-0-128-118 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 23:48:46.129895 ip-10-0-128-118 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:48:46.132044 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.131956    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 23:48:46.134729 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134713    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:48:46.134729 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134729    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134732    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134736    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134739    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134743    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134746    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134748    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134751    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134754    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134757    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134760    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134762    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134765    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134767    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134770    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134772    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134777    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134791    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:48:46.134787 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134795    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134799    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134802    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134804    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134807    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134810    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134813    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134815    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134819    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134821    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134824    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134827    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134829    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134832    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134834    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134838    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134841    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134844    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134847    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134850    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:48:46.135262 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134853    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134856    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134859    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134861    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134864    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134866    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134869    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134871    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134874    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134876    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134879    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134881    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134883    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134886    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134889    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134893    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134895    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134898    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134900    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134903    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:48:46.135744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134906    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134908    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134911    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134913    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134916    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134918    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134921    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134923    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134926    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134941    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134944    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134947    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134949    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134952    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134957    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134961    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134964    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134967    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134970    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:48:46.136239 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134972    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134975    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134977    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134980    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134983    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134985    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134988    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134992    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134995    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.134997    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135000    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135002    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135005    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135008    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135010    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135012    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135015    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135018    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135020    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:48:46.136699 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135023    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135025    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135812    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135821    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135824    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135827    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135829    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135833    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135836    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135841    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135845    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135850    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135853    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135856    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135858    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135861    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135863    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135866    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135869    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135872    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:48:46.137168 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135875    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135878    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135881    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135884    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135886    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135889    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135891    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135894    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135896    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135899    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135903    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135906    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135909    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135912    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135914    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135917    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135919    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135922    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135924    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135927    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:48:46.137684 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135943    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135946    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135951    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135955    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135958    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135961    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135964    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135967    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135971    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135976    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135980    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135983    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135986    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135989    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135992    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135995    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.135998    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136000    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136004    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:48:46.138188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136006    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136009    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136012    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136014    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136017    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136020    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136022    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136025    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136027    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136029    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136032    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136035    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136037    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136041    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136043    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136046    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136050    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136052    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136055    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136057    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:48:46.138659 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136060    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136063    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136066    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136068    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136071    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136074    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136076    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136079    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136081    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136084    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136087    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136089    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136092    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136095    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136097    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136100    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136103    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136105    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136108    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136110    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:48:46.139158 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136113    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136115    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136497    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136502    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136505    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136509    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136512    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136515    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136518    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136521    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136523    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136526    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136529    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136532    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136534    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136537    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136540    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136543    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136545    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136548    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136550    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:48:46.139649 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136552    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136555    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136559    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136563    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136566    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136569    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136571    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136574    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136576    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136579    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136585    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136587    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136592    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136595    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136598    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136600    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136603    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136606    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136609    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:48:46.140171 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136611    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136614    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136617    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136620    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136622    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136625    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136629    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136632    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136635    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136638    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136641    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136644    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136646    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136649    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136651    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136654    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136658    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136661    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136664    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:48:46.140630 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136666    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136669    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136672    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136675    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136678    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136681    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136684    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136686    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136689    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136692    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136694    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136697    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136699    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136702    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136705    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136708    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136711    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136713    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136716    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:48:46.141098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136718    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136721    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136724    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136726    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136728    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136731    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136733    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136736    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136739    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136742    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136746    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136748    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136751    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136753    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136755    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136758    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136760    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136764    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136767    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:48:46.141565 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136769    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136772    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136774    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.136777    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136843    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136876    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136890    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136899    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136903    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136906    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136911    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136915    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136918    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136921    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136925    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136943    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136947    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136950    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136952    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136955    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136958    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136961    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136965    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 09 23:48:46.142016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136968    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136971    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136974    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136978    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136981    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136984    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136987    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136992    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136995    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.136998    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137001    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137004    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137007    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137011    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137014    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137017    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137020    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137022    2560 flags.go:64] FLAG: --enable-server="true"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137025    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137030    2560 flags.go:64] FLAG: --event-burst="100"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137034    2560 flags.go:64] FLAG: --event-qps="50"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137037    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137040    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137043    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 09 23:48:46.142567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137047    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137049    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137052    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137055    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137058    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137061    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137064    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137067    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137071    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137073    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137077    2560 flags.go:64] FLAG: --feature-gates=""
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137080    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137083    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137086    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137089    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137093    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137096    2560 flags.go:64] FLAG: --help="false"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137099    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137103    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137106    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137109    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137112    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137116    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137118    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 23:48:46.143194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137121    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137124    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137127    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137130    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137133    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137136    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137139    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137142    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137145    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137147    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137150    2560 flags.go:64] FLAG: --lock-file=""
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137153    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137156    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137159    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137164    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137167    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137170    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137173    2560 flags.go:64] FLAG: --logging-format="text"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137176    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137179    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137182    2560 flags.go:64] FLAG: --manifest-url=""
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137185    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137189    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137193    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137197    2560 flags.go:64] FLAG: --max-pods="110"
Sep 09 23:48:46.143873 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137200    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137203    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137206    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137209    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137211    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137214    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137217    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137223    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137226    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137229    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137232    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137235    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137240    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137243    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137246    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137249    2560 flags.go:64] FLAG: --port="10250"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137252    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137255    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08e89a3d77239799d"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137258    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137260    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137263    2560 flags.go:64] FLAG: --register-node="true"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137266    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137271    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137274    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 09 23:48:46.144809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137276    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137279    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137282    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137285    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137288    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137291    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137294    2560 flags.go:64] FLAG: --runonce="false"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137297    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137300    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137303    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137306    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137309    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137312    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137315    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137318    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137321    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137324    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137326    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137329    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137332    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137335    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137338    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137344    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137347    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137350    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 23:48:46.145464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137354    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137357    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137360    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137362    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137365    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137370    2560 flags.go:64] FLAG: --v="2"
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137374    2560 flags.go:64] FLAG: --version="false"
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137378    2560 flags.go:64] FLAG: --vmodule=""
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137381    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.137384    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137495    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137498    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137502    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137505    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137508    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137511    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137514    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137517    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137519    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137522    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137525    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137527    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:48:46.146078 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137530    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137534    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137537    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137540    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137543    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137546    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137548    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137551    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137554    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137556    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137559    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137561    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137564    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137567    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137570    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137575    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137578    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137581    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137584    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:48:46.146627 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137586    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137589    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137591    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137594    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137597    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137599    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137602    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137604    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137607    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137609    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137612    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137615    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137617    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137620    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137623    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137626    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137629    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137633    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137637    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:48:46.147142 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137641    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137644    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137647    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137650    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137653    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137655    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137658    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137660    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137663    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137667    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137669    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137672    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137674    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137677    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137679    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137681    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137684    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137688    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137691    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:48:46.147594 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137693    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137696    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137699    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137701    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137704    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137707    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137709    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137712    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137714    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137717    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137720    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137722    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137725    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137728    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137730    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137734    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137737    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137740    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137743    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137746    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:48:46.148154 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137749    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137751    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137755    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137758    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137761    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137764    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137766    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137769    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137771    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.137774    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.138199    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.146038    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.146052    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.146953    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.146960    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 23:48:46.148646 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147016    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147020    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147023    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147026    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147029    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147033    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147036    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147039    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147041    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147044    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147047    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147049    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147052    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147055    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147058    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147060    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147063    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147067    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147071    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:48:46.149028 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147074    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147077    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147080    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147083    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147086    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147089    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147093    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147096    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147100    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147103    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147106    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147109    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147112    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147115    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147117    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147120    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147123    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147126    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147128    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:48:46.149490 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147131    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147134    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147136    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147139    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147141    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147144    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147147    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147149    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147152    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147155    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147158    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147161    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147164    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147166    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147169    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147171    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147174    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147177    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147179    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147182    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:48:46.150019 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147185    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147187    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147189    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147193    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147196    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147199    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147201    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147204    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147207    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147209    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147212    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147214    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147217    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147220    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147223    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147226    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147228    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147231    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147234    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147236    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:48:46.150545 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147239    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147242    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147245    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147247    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147250    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147253    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147255    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147258    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147262    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147265    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147268    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147271    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147274    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147276    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147296    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147300    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147304    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147307    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147311    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147314    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:48:46.151048 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147317    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.147322    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147444    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147449    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147452    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147455    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147458    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147460    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147463    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147466    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147469    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147472    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147475    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147478    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:48:46.151534 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147483    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147487    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147490    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147492    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147495    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147498    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147501    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147504    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147507    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147509    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147512    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147514    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147517    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147520    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147523    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147526    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147528    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147531    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147534    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147536    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:48:46.151878 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147539    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147541    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147544    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147546    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147549    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147551    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147554    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147556    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147559    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147561    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147564    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147566    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147569    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147572    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147575    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147577    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147580    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147582    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147585    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147588    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:48:46.152387 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147590    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147593    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147595    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147598    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147601    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147604    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147607    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147609    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147613    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147616    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147619    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147621    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147624    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147626    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147629    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147632    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147634    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147637    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147640    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:48:46.152862 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147642    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147645    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147648    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147650    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147653    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147655    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147658    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147661    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147664    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147666    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147669    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147671    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147674    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147676    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147679    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147681    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147683    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147686    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147688    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147692    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:48:46.153394 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147695    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147698    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147700    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147703    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147705    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147707    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147710    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:46.147712    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.147717    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.147819    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.150831    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.151681    2560 server.go:1019] "Starting client certificate rotation"
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.151782    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 23:48:46.153863 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.151817    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 23:48:46.154203 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.153895    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 23:48:46.156563 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.156543    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 23:48:46.167921 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.167904    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 09 23:48:46.171015 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.170997    2560 log.go:25] "Validated CRI v1 image API"
Sep 09 23:48:46.171822 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.171806    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 23:48:46.174001 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.173982    2560 fs.go:135] Filesystem UUIDs: map[3dbc4612-9756-40ff-8867-13bdd51cd72a:/dev/nvme0n1p3 567ac60a-0fc7-4d0d-8e76-dc4c3d8497d3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 09 23:48:46.174071 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.174000    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 23:48:46.178464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.178446    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 23:48:46.178768 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.178661    2560 manager.go:216] Machine: {Timestamp:2026-09-09 23:48:46.177458287 +0000 UTC m=+0.309585506 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100592 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26790ceb5c3f7db0219f934343372f SystemUUID:ec26790c-eb5c-3f7d-b021-9f934343372f BootID:cfa19df1-8530-4b59-bf24-4665814e0298 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:2a:e0:f2:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:2a:e0:f2:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:8e:43:5a:07:ed Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 23:48:46.178768 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.178766    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 23:48:46.178857 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.178843    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 23:48:46.180370 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.180338    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 23:48:46.180492 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.180371    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 23:48:46.181041 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.181030    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 23:48:46.181079 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.181044    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 23:48:46.181079 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.181051    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 23:48:46.182274 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.182263    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 23:48:46.183017 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.183007    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 23:48:46.186704 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.186693    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 23:48:46.186812 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.186803    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 23:48:46.186841 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.186833    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 23:48:46.186871 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.186844    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 23:48:46.186871 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.186866    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 23:48:46.186947 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.186876    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 09 23:48:46.186947 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.186885    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 23:48:46.187238 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.187226    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 23:48:46.187275 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.187248    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 23:48:46.189057 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.189036    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 23:48:46.191021 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.191007    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 23:48:46.191088 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.191036    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 23:48:46.191928 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.191915    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 23:48:46.192000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.191953    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 23:48:46.192000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.191963    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 23:48:46.192000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.191970    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 23:48:46.192000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.191980    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 23:48:46.192000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.191988    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 23:48:46.192136 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.192056    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 23:48:46.192136 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.192063    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 23:48:46.192136 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.192070    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 23:48:46.192136 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.192076    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 23:48:46.192136 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.192093    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 23:48:46.192136 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.192101    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 23:48:46.192879 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.192868    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 23:48:46.192911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.192879    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 23:48:46.196310 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.196285    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 23:48:46.196310 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.196296    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 23:48:46.196412 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.196324    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 23:48:46.196869 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.196856    2560 server.go:1268] "Started kubelet"
Sep 09 23:48:46.197036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.196986    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 23:48:46.197093 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.197065    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 23:48:46.197437 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.197411    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 23:48:46.197756 ip-10-0-128-118 systemd[1]: Started Kubernetes Kubelet.
Sep 09 23:48:46.198105 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.198090    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 23:48:46.200855 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.200838    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 23:48:46.203027 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.203004    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 23:48:46.205266 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.205250    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8r5vl"
Sep 09 23:48:46.205561 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.205546    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 23:48:46.206026 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.206006    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 23:48:46.206103 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.206086    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:46.206488 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.206473    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 23:48:46.206562 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.206502    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 23:48:46.206562 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.206521    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 23:48:46.206667 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.206616    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 23:48:46.206667 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.206627    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 23:48:46.206861 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.206848    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 23:48:46.206900 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.206862    2560 factory.go:55] Registering systemd factory
Sep 09 23:48:46.206900 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.206869    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 09 23:48:46.207080 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.207069    2560 factory.go:153] Registering CRI-O factory
Sep 09 23:48:46.207114 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.207085    2560 factory.go:223] Registration of the crio container factory successfully
Sep 09 23:48:46.207114 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.207099    2560 factory.go:103] Registering Raw factory
Sep 09 23:48:46.207114 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.207111    2560 manager.go:1196] Started watching for new ooms in manager
Sep 09 23:48:46.207448 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.207432    2560 manager.go:349] Starting recovery of all containers
Sep 09 23:48:46.209675 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.209644    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 23:48:46.209768 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.209711    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 23:48:46.210606 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.209726    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-118.ec2.internal.18d3cbf415f16b16  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-118.ec2.internal,UID:ip-10-0-128-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-118.ec2.internal,},FirstTimestamp:2026-09-09 23:48:46.196820758 +0000 UTC m=+0.328948026,LastTimestamp:2026-09-09 23:48:46.196820758 +0000 UTC m=+0.328948026,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-118.ec2.internal,}"
Sep 09 23:48:46.213187 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.213165    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8r5vl"
Sep 09 23:48:46.214265 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.214051    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 23:48:46.215321 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.215305    2560 manager.go:354] Recovery completed
Sep 09 23:48:46.219703 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.219685    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:48:46.221383 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.221369    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:48:46.221447 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.221394    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:48:46.221447 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.221405    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:48:46.221974 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.221961    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 23:48:46.221974 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.221970    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:48:46.221974 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.221974    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 23:48:46.222136 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.221991    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 23:48:46.222645 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.222629    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:48:46.222645 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.222655    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:48:46.222763 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.222667    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:48:46.223555 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.223310    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-118.ec2.internal.18d3cbf4176833f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-118.ec2.internal,UID:ip-10-0-128-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-118.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-118.ec2.internal,},FirstTimestamp:2026-09-09 23:48:46.221382643 +0000 UTC m=+0.353509861,LastTimestamp:2026-09-09 23:48:46.221382643 +0000 UTC m=+0.353509861,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-118.ec2.internal,}"
Sep 09 23:48:46.224693 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.224127    2560 policy_none.go:49] "None policy: Start"
Sep 09 23:48:46.224693 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.224146    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 23:48:46.224693 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.224159    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 23:48:46.226183 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.226140    2560 policy_none.go:47] "Start"
Sep 09 23:48:46.256528 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.256512    2560 manager.go:337] "Starting Device Plugin manager"
Sep 09 23:48:46.256630 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.256553    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 23:48:46.256630 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.256565    2560 server.go:87] "Starting device plugin registration server"
Sep 09 23:48:46.256895 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.256879    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 23:48:46.257097 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.256898    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 23:48:46.257179 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.257119    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 23:48:46.257227 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.257202    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 23:48:46.257227 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.257211    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 23:48:46.257800 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.257780    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 23:48:46.257904 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.257828    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:46.333020 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.332994    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 23:48:46.333113 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.333051    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 23:48:46.333113 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.333074    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 23:48:46.333186 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.333154    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 23:48:46.334904 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.334886    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:48:46.357700 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.357680    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:48:46.358894 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.358874    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:48:46.359004 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.358907    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:48:46.359004 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.358918    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:48:46.359004 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.358953    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.366424 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.366410    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.366479 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.366431    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-118.ec2.internal\": node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:46.375596 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.375580    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:46.433961 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.433870    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"]
Sep 09 23:48:46.434048 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.433971    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:48:46.434777 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.434762    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:48:46.434847 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.434787    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:48:46.434847 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.434800    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:48:46.437141 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.437130    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:48:46.437272 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.437258    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.437317 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.437292    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:48:46.437816 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.437802    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:48:46.437816 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.437812    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:48:46.437906 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.437826    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:48:46.437906 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.437834    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:48:46.437906 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.437838    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:48:46.437906 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.437844    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:48:46.440541 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.440525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.440607 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.440549    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:48:46.441153 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.441143    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:48:46.441223 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.441164    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:48:46.441223 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.441172    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:48:46.475490 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.475466    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-118.ec2.internal\" not found" node="ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.476135 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.476119    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:46.479716 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.479699    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-118.ec2.internal\" not found" node="ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.508000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.507982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b61d50ed0606a862d1a406369ed1260e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"b61d50ed0606a862d1a406369ed1260e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.508058 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.508011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29f890174e08c201af11a053bc521344-config\") pod \"kube-apiserver-proxy-ip-10-0-128-118.ec2.internal\" (UID: \"29f890174e08c201af11a053bc521344\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.508058 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.508028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b61d50ed0606a862d1a406369ed1260e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"b61d50ed0606a862d1a406369ed1260e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.576578 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.576560    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:46.608917 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.608895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29f890174e08c201af11a053bc521344-config\") pod \"kube-apiserver-proxy-ip-10-0-128-118.ec2.internal\" (UID: \"29f890174e08c201af11a053bc521344\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.608996 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.608919    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b61d50ed0606a862d1a406369ed1260e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"b61d50ed0606a862d1a406369ed1260e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.608996 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.608947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b61d50ed0606a862d1a406369ed1260e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"b61d50ed0606a862d1a406369ed1260e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.609067 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.609001    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29f890174e08c201af11a053bc521344-config\") pod \"kube-apiserver-proxy-ip-10-0-128-118.ec2.internal\" (UID: \"29f890174e08c201af11a053bc521344\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.609067 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.609008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b61d50ed0606a862d1a406369ed1260e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"b61d50ed0606a862d1a406369ed1260e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.609139 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.609064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b61d50ed0606a862d1a406369ed1260e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"b61d50ed0606a862d1a406369ed1260e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.677201 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.677165    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:46.777905 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.777840    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.778006 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.777843    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:46.782662 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:46.782585    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:46.878390 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.878362    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:46.978880 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:46.978848    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:47.084512 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:47.084474    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:47.153762 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.153735    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 23:48:47.154219 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.153888    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 23:48:47.184722 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:47.184687    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:47.218421 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.218379    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:43:46 +0000 UTC" deadline="2028-06-27 17:32:09.453961894 +0000 UTC"
Sep 09 23:48:47.218421 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.218415    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15761h43m22.235550072s"
Sep 09 23:48:47.224185 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.224167    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:48:47.286325 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:47.286286    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:47.389287 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:47.389230    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:47.489967 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:47.489922    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:47.496734 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.496713    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:48:47.587000 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:47.586878    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f890174e08c201af11a053bc521344.slice/crio-edfc97dde071f9be641e9a60d66183e63c69644f0e7c01df12e00ce1ceee84f4 WatchSource:0}: Error finding container edfc97dde071f9be641e9a60d66183e63c69644f0e7c01df12e00ce1ceee84f4: Status 404 returned error can't find the container with id edfc97dde071f9be641e9a60d66183e63c69644f0e7c01df12e00ce1ceee84f4
Sep 09 23:48:47.589277 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:47.589255    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb61d50ed0606a862d1a406369ed1260e.slice/crio-3303949372d284fc11139f60fdd730efa78e51632f6295017d7e5da5f50d7b5a WatchSource:0}: Error finding container 3303949372d284fc11139f60fdd730efa78e51632f6295017d7e5da5f50d7b5a: Status 404 returned error can't find the container with id 3303949372d284fc11139f60fdd730efa78e51632f6295017d7e5da5f50d7b5a
Sep 09 23:48:47.590367 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:47.590341    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Sep 09 23:48:47.593066 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.593052    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:48:47.657317 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.657269    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:48:47.706557 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.706524    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:47.719303 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.719286    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 23:48:47.720263 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.720249    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Sep 09 23:48:47.729168 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:47.729151    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 23:48:48.188272 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.188235    2560 apiserver.go:52] "Watching apiserver"
Sep 09 23:48:48.200842 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.199654    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 23:48:48.201501 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.201476    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2n8gz","openshift-multus/multus-5fgsw","openshift-multus/network-metrics-daemon-pjdw5","openshift-network-operator/iptables-alerter-7bzrq","openshift-ovn-kubernetes/ovnkube-node-xzg8m","kube-system/global-pull-secret-syncer-6lnx6","kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal","openshift-dns/node-resolver-77v6t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal","openshift-multus/multus-additional-cni-plugins-nqld6","openshift-network-diagnostics/network-check-target-gmps7","kube-system/konnectivity-agent-7g9v9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw","openshift-cluster-node-tuning-operator/tuned-wcnhr"]
Sep 09 23:48:48.205620 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.205599    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.206512 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.206491    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 23:48:48.207909 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.207888    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.208214 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.208191    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-276v9\""
Sep 09 23:48:48.208621 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.208600    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 23:48:48.208621 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.208613    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 23:48:48.208621 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.208619    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 23:48:48.208820 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.208613    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 23:48:48.208820 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.208701    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 23:48:48.210927 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.210490    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 23:48:48.210927 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.210551    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 23:48:48.210927 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.210564    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 23:48:48.210927 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.210660    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7drwl\""
Sep 09 23:48:48.211201 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.211010    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:48.211201 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.211087    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:48:48.213651 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.213633    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.215907 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.215874    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:48:48.216032 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.215912    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.216103 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.216055    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 23:48:48.216328 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.216310    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kjppv\""
Sep 09 23:48:48.216438 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.216365    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 23:48:48.216695 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.216673    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 23:48:48.218380 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.218341    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:48.218477 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.218403    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:48:48.219228 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219199    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 23:48:48.219228 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-device-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.219368 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f567dc0-4b50-4f89-8c59-6857c128767a-system-cni-dir\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.219368 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f567dc0-4b50-4f89-8c59-6857c128767a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.219368 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f567dc0-4b50-4f89-8c59-6857c128767a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.219368 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-registration-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.219368 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-etc-selinux\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.219629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f567dc0-4b50-4f89-8c59-6857c128767a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.219629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-socket-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.219629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-sys-fs\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.219629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f567dc0-4b50-4f89-8c59-6857c128767a-cnibin\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.219629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svqk8\" (UniqueName: \"kubernetes.io/projected/9f567dc0-4b50-4f89-8c59-6857c128767a-kube-api-access-svqk8\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.219629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219521    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9d65\" (UniqueName: \"kubernetes.io/projected/1cb6bb82-63cb-486a-a746-0809ba70ad09-kube-api-access-g9d65\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.219629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219560    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f567dc0-4b50-4f89-8c59-6857c128767a-cni-binary-copy\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.219629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.220072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219786    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nm8xx\""
Sep 09 23:48:48.220072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219849    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 23:48:48.220072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.219980    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 23:48:48.220215 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.220106    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 23:48:48.220215 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.220107    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 23:48:48.220215 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.220141    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 23:48:48.220907 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.220886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.223292 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.223272    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 23:48:48.223400 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.223377    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-87jk9\""
Sep 09 23:48:48.223550 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.223536    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.223707 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.223683    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:48:48.226029 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.225988    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p7ksc\""
Sep 09 23:48:48.226130 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.226040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.226323 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.226275    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 23:48:48.226843 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.226824    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 23:48:48.229068 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.228745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.229068 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.228866    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kxbph\""
Sep 09 23:48:48.229409 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.229380    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 23:48:48.233766 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.233282    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 23:48:48.233766 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.233570    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 23:48:48.234592 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.234154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:48.234592 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.234245    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:48:48.234592 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.234337    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 23:48:48.234592 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.234511    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bxd9l\""
Sep 09 23:48:48.237560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.237540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:48:48.238681 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.238658    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s546x"
Sep 09 23:48:48.240173 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.240153    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 23:48:48.240267 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.240153    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 23:48:48.240267 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.240159    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c8lr4\""
Sep 09 23:48:48.248426 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.248406    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s546x"
Sep 09 23:48:48.299909 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.299885    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:48:48.307802 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.307782    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 23:48:48.320513 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daf0b287-7915-4114-afcb-cf729ae449bc-host\") pod \"node-ca-2n8gz\" (UID: \"daf0b287-7915-4114-afcb-cf729ae449bc\") " pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.320632 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-run\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.320632 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-systemd-units\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.320632 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-ovnkube-config\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.320632 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320604    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-env-overrides\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.320632 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320627    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89-agent-certs\") pod \"konnectivity-agent-7g9v9\" (UID: \"ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89\") " pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:48:48.320911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89-konnectivity-ca\") pod \"konnectivity-agent-7g9v9\" (UID: \"ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89\") " pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:48:48.320911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9d65\" (UniqueName: \"kubernetes.io/projected/1cb6bb82-63cb-486a-a746-0809ba70ad09-kube-api-access-g9d65\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.320911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-lib-modules\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.320911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-multus-cni-dir\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.320911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-multus-socket-dir-parent\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.320911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-run-netns\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.320911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7171a24b-d7c1-415c-a7e3-a88b72df36fb-hosts-file\") pod \"node-resolver-77v6t\" (UID: \"7171a24b-d7c1-415c-a7e3-a88b72df36fb\") " pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.320911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-var-lib-kubelet\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.320911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-etc-kubernetes\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.320911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-kubelet\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.320981    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-run-ovn-kubernetes\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-ovnkube-script-lib\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f567dc0-4b50-4f89-8c59-6857c128767a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f567dc0-4b50-4f89-8c59-6857c128767a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-cnibin\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321163    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjqpw\" (UniqueName: \"kubernetes.io/projected/daf0b287-7915-4114-afcb-cf729ae449bc-kube-api-access-jjqpw\") pod \"node-ca-2n8gz\" (UID: \"daf0b287-7915-4114-afcb-cf729ae449bc\") " pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b5f02aaa-b717-416a-8ff4-b66857a29e63-iptables-alerter-script\") pod \"iptables-alerter-7bzrq\" (UID: \"b5f02aaa-b717-416a-8ff4-b66857a29e63\") " pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f567dc0-4b50-4f89-8c59-6857c128767a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-run-netns\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-var-lib-kubelet\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321307    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/636c9650-cf74-4c56-8595-afdb6d29702e-multus-daemon-config\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhphv\" (UniqueName: \"kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv\") pod \"network-check-target-gmps7\" (UID: \"7aa7246e-4bbd-4094-a61a-d69b8cee2336\") " pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-host\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f567dc0-4b50-4f89-8c59-6857c128767a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/636c9650-cf74-4c56-8595-afdb6d29702e-cni-binary-copy\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.321461 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-sys\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-run-multus-certs\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-run-systemd\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-run-openvswitch\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-log-socket\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-cni-bin\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-dbus\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-device-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/daf0b287-7915-4114-afcb-cf729ae449bc-serviceca\") pod \"node-ca-2n8gz\" (UID: \"daf0b287-7915-4114-afcb-cf729ae449bc\") " pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-tuned\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-hostroot\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f567dc0-4b50-4f89-8c59-6857c128767a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321805    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-device-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-var-lib-openvswitch\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.322283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-etc-openvswitch\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f567dc0-4b50-4f89-8c59-6857c128767a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-ovn-node-metrics-cert\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.321996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-kubelet-config\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322025    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p7pk\" (UniqueName: \"kubernetes.io/projected/7171a24b-d7c1-415c-a7e3-a88b72df36fb-kube-api-access-7p7pk\") pod \"node-resolver-77v6t\" (UID: \"7171a24b-d7c1-415c-a7e3-a88b72df36fb\") " pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs5h2\" (UniqueName: \"kubernetes.io/projected/b5f02aaa-b717-416a-8ff4-b66857a29e63-kube-api-access-bs5h2\") pod \"iptables-alerter-7bzrq\" (UID: \"b5f02aaa-b717-416a-8ff4-b66857a29e63\") " pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-sysctl-conf\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w2dm\" (UniqueName: \"kubernetes.io/projected/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-kube-api-access-4w2dm\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-run-k8s-cni-cncf-io\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7171a24b-d7c1-415c-a7e3-a88b72df36fb-tmp-dir\") pod \"node-resolver-77v6t\" (UID: \"7171a24b-d7c1-415c-a7e3-a88b72df36fb\") " pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f567dc0-4b50-4f89-8c59-6857c128767a-system-cni-dir\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-var-lib-cni-multus\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkn9g\" (UniqueName: \"kubernetes.io/projected/636c9650-cf74-4c56-8595-afdb6d29702e-kube-api-access-gkn9g\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-slash\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f567dc0-4b50-4f89-8c59-6857c128767a-system-cni-dir\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.323207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322280    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-cni-netd\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-socket-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-node-log\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f567dc0-4b50-4f89-8c59-6857c128767a-cnibin\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svqk8\" (UniqueName: \"kubernetes.io/projected/9f567dc0-4b50-4f89-8c59-6857c128767a-kube-api-access-svqk8\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f567dc0-4b50-4f89-8c59-6857c128767a-cnibin\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-kubernetes\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-run-ovn\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6896\" (UniqueName: \"kubernetes.io/projected/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-kube-api-access-k6896\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5f02aaa-b717-416a-8ff4-b66857a29e63-host-slash\") pod \"iptables-alerter-7bzrq\" (UID: \"b5f02aaa-b717-416a-8ff4-b66857a29e63\") " pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f567dc0-4b50-4f89-8c59-6857c128767a-cni-binary-copy\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-sysconfig\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-socket-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-sysctl-d\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-system-cni-dir\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-var-lib-cni-bin\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-multus-conf-dir\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.324072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t24h\" (UniqueName: \"kubernetes.io/projected/b6a27c9e-ee55-4d2b-ac35-25b474a89304-kube-api-access-2t24h\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-registration-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-etc-selinux\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-sys-fs\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322880    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-registration-dir\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322923    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-etc-selinux\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-modprobe-d\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.322983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cb6bb82-63cb-486a-a746-0809ba70ad09-sys-fs\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.323016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-systemd\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.323039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-tmp\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.324926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.323178    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f567dc0-4b50-4f89-8c59-6857c128767a-cni-binary-copy\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.327457 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.327427    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 23:48:48.331717 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.331694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svqk8\" (UniqueName: \"kubernetes.io/projected/9f567dc0-4b50-4f89-8c59-6857c128767a-kube-api-access-svqk8\") pod \"multus-additional-cni-plugins-nqld6\" (UID: \"9f567dc0-4b50-4f89-8c59-6857c128767a\") " pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.331843 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.331776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9d65\" (UniqueName: \"kubernetes.io/projected/1cb6bb82-63cb-486a-a746-0809ba70ad09-kube-api-access-g9d65\") pod \"aws-ebs-csi-driver-node-sjxqw\" (UID: \"1cb6bb82-63cb-486a-a746-0809ba70ad09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.338905 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.338811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal" event={"ID":"b61d50ed0606a862d1a406369ed1260e","Type":"ContainerStarted","Data":"3303949372d284fc11139f60fdd730efa78e51632f6295017d7e5da5f50d7b5a"}
Sep 09 23:48:48.340165 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.340134    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal" event={"ID":"29f890174e08c201af11a053bc521344","Type":"ContainerStarted","Data":"edfc97dde071f9be641e9a60d66183e63c69644f0e7c01df12e00ce1ceee84f4"}
Sep 09 23:48:48.423646 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423618    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-cnibin\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.423797 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-cnibin\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.423797 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqpw\" (UniqueName: \"kubernetes.io/projected/daf0b287-7915-4114-afcb-cf729ae449bc-kube-api-access-jjqpw\") pod \"node-ca-2n8gz\" (UID: \"daf0b287-7915-4114-afcb-cf729ae449bc\") " pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.423797 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b5f02aaa-b717-416a-8ff4-b66857a29e63-iptables-alerter-script\") pod \"iptables-alerter-7bzrq\" (UID: \"b5f02aaa-b717-416a-8ff4-b66857a29e63\") " pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.423797 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-run-netns\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.423797 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-var-lib-kubelet\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.424086 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/636c9650-cf74-4c56-8595-afdb6d29702e-multus-daemon-config\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.424086 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhphv\" (UniqueName: \"kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv\") pod \"network-check-target-gmps7\" (UID: \"7aa7246e-4bbd-4094-a61a-d69b8cee2336\") " pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:48.424086 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-host\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.424086 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-host\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.424086 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/636c9650-cf74-4c56-8595-afdb6d29702e-cni-binary-copy\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.424086 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.423999    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-var-lib-kubelet\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.424086 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-sys\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.424086 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-run-netns\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.424705 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424673    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/636c9650-cf74-4c56-8595-afdb6d29702e-multus-daemon-config\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.424812 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-run-multus-certs\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.424812 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424796    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-run-systemd\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.424939 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-run-openvswitch\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.424939 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-log-socket\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.424939 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424916    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-cni-bin\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.425117 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-dbus\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:48.425117 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b5f02aaa-b717-416a-8ff4-b66857a29e63-iptables-alerter-script\") pod \"iptables-alerter-7bzrq\" (UID: \"b5f02aaa-b717-416a-8ff4-b66857a29e63\") " pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.425117 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.424992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/daf0b287-7915-4114-afcb-cf729ae449bc-serviceca\") pod \"node-ca-2n8gz\" (UID: \"daf0b287-7915-4114-afcb-cf729ae449bc\") " pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.425117 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425093    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-run-systemd\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.425117 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-run-openvswitch\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.425382 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-cni-bin\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.425382 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-sys\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.425382 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-log-socket\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.425382 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-dbus\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:48.425382 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-run-multus-certs\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.425382 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:48.425814 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-tuned\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.425814 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-hostroot\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.425814 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-var-lib-openvswitch\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.425814 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/636c9650-cf74-4c56-8595-afdb6d29702e-cni-binary-copy\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.425814 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-etc-openvswitch\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.425814 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425641    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-var-lib-openvswitch\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.425814 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.425753    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/daf0b287-7915-4114-afcb-cf729ae449bc-serviceca\") pod \"node-ca-2n8gz\" (UID: \"daf0b287-7915-4114-afcb-cf729ae449bc\") " pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.426594 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.426437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-etc-openvswitch\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.426594 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.426480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.426594 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.426543    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-hostroot\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.426594 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.426561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-ovn-node-metrics-cert\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.426782 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.426678    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:48:48.426782 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.426693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-kubelet-config\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:48.426782 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.426743    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p7pk\" (UniqueName: \"kubernetes.io/projected/7171a24b-d7c1-415c-a7e3-a88b72df36fb-kube-api-access-7p7pk\") pod \"node-resolver-77v6t\" (UID: \"7171a24b-d7c1-415c-a7e3-a88b72df36fb\") " pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.426782 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.426758    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret podName:1e350ffb-631f-4f97-ba20-f4b8d39b08e1 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:48.926737891 +0000 UTC m=+3.058865120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret") pod "global-pull-secret-syncer-6lnx6" (UID: "1e350ffb-631f-4f97-ba20-f4b8d39b08e1") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:48:48.426958 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.426854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-kubelet-config\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:48.427016 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.426990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs5h2\" (UniqueName: \"kubernetes.io/projected/b5f02aaa-b717-416a-8ff4-b66857a29e63-kube-api-access-bs5h2\") pod \"iptables-alerter-7bzrq\" (UID: \"b5f02aaa-b717-416a-8ff4-b66857a29e63\") " pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.427264 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.427036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-sysctl-conf\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.427342 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.427291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.427342 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.427301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w2dm\" (UniqueName: \"kubernetes.io/projected/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-kube-api-access-4w2dm\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.427449 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.427368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-run-k8s-cni-cncf-io\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.427449 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.427403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7171a24b-d7c1-415c-a7e3-a88b72df36fb-tmp-dir\") pod \"node-resolver-77v6t\" (UID: \"7171a24b-d7c1-415c-a7e3-a88b72df36fb\") " pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.427449 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.427410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-sysctl-conf\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.427596 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.427438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-var-lib-cni-multus\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.427596 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.427487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-run-k8s-cni-cncf-io\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.427699 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.427604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-var-lib-cni-multus\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.428188 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.428099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkn9g\" (UniqueName: \"kubernetes.io/projected/636c9650-cf74-4c56-8595-afdb6d29702e-kube-api-access-gkn9g\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.428366 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.428344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7171a24b-d7c1-415c-a7e3-a88b72df36fb-tmp-dir\") pod \"node-resolver-77v6t\" (UID: \"7171a24b-d7c1-415c-a7e3-a88b72df36fb\") " pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.431387 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.428708    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-tuned\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.431387 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.430165    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:48:48.431387 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.430188    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:48:48.431387 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.430201    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mhphv for pod openshift-network-diagnostics/network-check-target-gmps7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:48:48.431387 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.430240    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv podName:7aa7246e-4bbd-4094-a61a-d69b8cee2336 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:48.930228086 +0000 UTC m=+3.062355329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mhphv" (UniqueName: "kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv") pod "network-check-target-gmps7" (UID: "7aa7246e-4bbd-4094-a61a-d69b8cee2336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:48:48.431387 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-ovn-node-metrics-cert\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.431387 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-slash\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-cni-netd\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-node-log\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-kubernetes\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-slash\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-run-ovn\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6896\" (UniqueName: \"kubernetes.io/projected/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-kube-api-access-k6896\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-run-ovn\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431589    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5f02aaa-b717-416a-8ff4-b66857a29e63-host-slash\") pod \"iptables-alerter-7bzrq\" (UID: \"b5f02aaa-b717-416a-8ff4-b66857a29e63\") " pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-cni-netd\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-sysconfig\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-kubernetes\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431652    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-node-log\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5f02aaa-b717-416a-8ff4-b66857a29e63-host-slash\") pod \"iptables-alerter-7bzrq\" (UID: \"b5f02aaa-b717-416a-8ff4-b66857a29e63\") " pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431702    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-sysconfig\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.431833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-sysctl-d\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-system-cni-dir\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.431951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-var-lib-cni-bin\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-multus-conf-dir\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t24h\" (UniqueName: \"kubernetes.io/projected/b6a27c9e-ee55-4d2b-ac35-25b474a89304-kube-api-access-2t24h\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-modprobe-d\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-systemd\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432185    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-sysctl-d\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-tmp\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daf0b287-7915-4114-afcb-cf729ae449bc-host\") pod \"node-ca-2n8gz\" (UID: \"daf0b287-7915-4114-afcb-cf729ae449bc\") " pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-run\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-multus-conf-dir\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-systemd-units\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-ovnkube-config\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-systemd\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-env-overrides\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89-agent-certs\") pod \"konnectivity-agent-7g9v9\" (UID: \"ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89\") " pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:48:48.432617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89-konnectivity-ca\") pod \"konnectivity-agent-7g9v9\" (UID: \"ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89\") " pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-lib-modules\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-multus-cni-dir\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-multus-socket-dir-parent\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-run-netns\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432246    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-host-var-lib-cni-bin\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-run\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7171a24b-d7c1-415c-a7e3-a88b72df36fb-hosts-file\") pod \"node-resolver-77v6t\" (UID: \"7171a24b-d7c1-415c-a7e3-a88b72df36fb\") " pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-run-netns\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-var-lib-kubelet\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-etc-kubernetes\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-kubelet\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432764    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-system-cni-dir\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-run-ovn-kubernetes\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-ovnkube-script-lib\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-systemd-units\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.432955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-multus-cni-dir\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.433202    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-env-overrides\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.433619 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.433416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-ovnkube-script-lib\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.433445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-ovnkube-config\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.433581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7171a24b-d7c1-415c-a7e3-a88b72df36fb-hosts-file\") pod \"node-resolver-77v6t\" (UID: \"7171a24b-d7c1-415c-a7e3-a88b72df36fb\") " pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.433636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-var-lib-kubelet\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.433674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-etc-kubernetes\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.433710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-kubelet\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.433749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-host-run-ovn-kubernetes\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.433882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-lib-modules\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.433962    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daf0b287-7915-4114-afcb-cf729ae449bc-host\") pod \"node-ca-2n8gz\" (UID: \"daf0b287-7915-4114-afcb-cf729ae449bc\") " pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.434209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/636c9650-cf74-4c56-8595-afdb6d29702e-multus-socket-dir-parent\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.434323    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.434376    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs podName:b6a27c9e-ee55-4d2b-ac35-25b474a89304 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:48.934358075 +0000 UTC m=+3.066485323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs") pod "network-metrics-daemon-pjdw5" (UID: "b6a27c9e-ee55-4d2b-ac35-25b474a89304") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.434406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89-konnectivity-ca\") pod \"konnectivity-agent-7g9v9\" (UID: \"ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89\") " pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:48:48.434560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.434470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-etc-modprobe-d\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.436601 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.435792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-tmp\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.436601 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.435660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjqpw\" (UniqueName: \"kubernetes.io/projected/daf0b287-7915-4114-afcb-cf729ae449bc-kube-api-access-jjqpw\") pod \"node-ca-2n8gz\" (UID: \"daf0b287-7915-4114-afcb-cf729ae449bc\") " pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.436601 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.436346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89-agent-certs\") pod \"konnectivity-agent-7g9v9\" (UID: \"ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89\") " pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:48:48.440385 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.440327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p7pk\" (UniqueName: \"kubernetes.io/projected/7171a24b-d7c1-415c-a7e3-a88b72df36fb-kube-api-access-7p7pk\") pod \"node-resolver-77v6t\" (UID: \"7171a24b-d7c1-415c-a7e3-a88b72df36fb\") " pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.443119 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.443094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w2dm\" (UniqueName: \"kubernetes.io/projected/dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46-kube-api-access-4w2dm\") pod \"tuned-wcnhr\" (UID: \"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46\") " pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.445502 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.445477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6896\" (UniqueName: \"kubernetes.io/projected/02cf0c64-f280-44e2-8fcf-5c96f9d88cef-kube-api-access-k6896\") pod \"ovnkube-node-xzg8m\" (UID: \"02cf0c64-f280-44e2-8fcf-5c96f9d88cef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.445734 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.445707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs5h2\" (UniqueName: \"kubernetes.io/projected/b5f02aaa-b717-416a-8ff4-b66857a29e63-kube-api-access-bs5h2\") pod \"iptables-alerter-7bzrq\" (UID: \"b5f02aaa-b717-416a-8ff4-b66857a29e63\") " pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.446185 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.446152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkn9g\" (UniqueName: \"kubernetes.io/projected/636c9650-cf74-4c56-8595-afdb6d29702e-kube-api-access-gkn9g\") pod \"multus-5fgsw\" (UID: \"636c9650-cf74-4c56-8595-afdb6d29702e\") " pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.448956 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.448931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t24h\" (UniqueName: \"kubernetes.io/projected/b6a27c9e-ee55-4d2b-ac35-25b474a89304-kube-api-access-2t24h\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:48.517752 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.517721    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nqld6"
Sep 09 23:48:48.525636 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.525596    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw"
Sep 09 23:48:48.532152 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:48.532120    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f567dc0_4b50_4f89_8c59_6857c128767a.slice/crio-4e7e760d9cac3adcb389a44001c3280ae4e568e20d7dba47c9d0d0ccaf5b77b6 WatchSource:0}: Error finding container 4e7e760d9cac3adcb389a44001c3280ae4e568e20d7dba47c9d0d0ccaf5b77b6: Status 404 returned error can't find the container with id 4e7e760d9cac3adcb389a44001c3280ae4e568e20d7dba47c9d0d0ccaf5b77b6
Sep 09 23:48:48.537589 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.537377    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bzrq"
Sep 09 23:48:48.538121 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:48.538088    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb6bb82_63cb_486a_a746_0809ba70ad09.slice/crio-75b4a87680f13614742ddb7f85d42d24601ae0d56e36f7bfda350f664986b555 WatchSource:0}: Error finding container 75b4a87680f13614742ddb7f85d42d24601ae0d56e36f7bfda350f664986b555: Status 404 returned error can't find the container with id 75b4a87680f13614742ddb7f85d42d24601ae0d56e36f7bfda350f664986b555
Sep 09 23:48:48.542954 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.542884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:48:48.550039 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.549868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wcnhr"
Sep 09 23:48:48.550554 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:48.550525    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f02aaa_b717_416a_8ff4_b66857a29e63.slice/crio-189831a1161a8c30230cff1386305bd241da850ff640e2d0795b811e3dd5537b WatchSource:0}: Error finding container 189831a1161a8c30230cff1386305bd241da850ff640e2d0795b811e3dd5537b: Status 404 returned error can't find the container with id 189831a1161a8c30230cff1386305bd241da850ff640e2d0795b811e3dd5537b
Sep 09 23:48:48.558247 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.558090    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-77v6t"
Sep 09 23:48:48.566297 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.566133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5fgsw"
Sep 09 23:48:48.574253 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.572979    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2n8gz"
Sep 09 23:48:48.579854 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.579797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:48:48.585232 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:48.585206    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7171a24b_d7c1_415c_a7e3_a88b72df36fb.slice/crio-228bd261aeca9ca9aadfd7ac66fe022e6eab97dc683db00b8c07c5d195af9893 WatchSource:0}: Error finding container 228bd261aeca9ca9aadfd7ac66fe022e6eab97dc683db00b8c07c5d195af9893: Status 404 returned error can't find the container with id 228bd261aeca9ca9aadfd7ac66fe022e6eab97dc683db00b8c07c5d195af9893
Sep 09 23:48:48.588055 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:48.587806    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636c9650_cf74_4c56_8595_afdb6d29702e.slice/crio-3fc5e51e999d25225122f6ec9580a2302c278e58d79ea5f3bc87e947965016c2 WatchSource:0}: Error finding container 3fc5e51e999d25225122f6ec9580a2302c278e58d79ea5f3bc87e947965016c2: Status 404 returned error can't find the container with id 3fc5e51e999d25225122f6ec9580a2302c278e58d79ea5f3bc87e947965016c2
Sep 09 23:48:48.595459 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:48:48.595388    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf0b287_7915_4114_afcb_cf729ae449bc.slice/crio-3c2303f738e5ae33e32fdd2dd9e6f52b9861fb0bdfcae011c892829eb74bc683 WatchSource:0}: Error finding container 3c2303f738e5ae33e32fdd2dd9e6f52b9861fb0bdfcae011c892829eb74bc683: Status 404 returned error can't find the container with id 3c2303f738e5ae33e32fdd2dd9e6f52b9861fb0bdfcae011c892829eb74bc683
Sep 09 23:48:48.936830 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.936792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:48.937034 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.936854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhphv\" (UniqueName: \"kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv\") pod \"network-check-target-gmps7\" (UID: \"7aa7246e-4bbd-4094-a61a-d69b8cee2336\") " pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:48.937034 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:48.936895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:48.937034 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.936975    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:48:48.937034 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.937023    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:48:48.937266 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.937058    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs podName:b6a27c9e-ee55-4d2b-ac35-25b474a89304 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:49.937036365 +0000 UTC m=+4.069163579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs") pod "network-metrics-daemon-pjdw5" (UID: "b6a27c9e-ee55-4d2b-ac35-25b474a89304") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:48:48.937266 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.937079    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret podName:1e350ffb-631f-4f97-ba20-f4b8d39b08e1 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:49.937070912 +0000 UTC m=+4.069198120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret") pod "global-pull-secret-syncer-6lnx6" (UID: "1e350ffb-631f-4f97-ba20-f4b8d39b08e1") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:48:48.937266 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.937077    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:48:48.937266 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.937103    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:48:48.937266 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.937117    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mhphv for pod openshift-network-diagnostics/network-check-target-gmps7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:48:48.937266 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:48.937177    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv podName:7aa7246e-4bbd-4094-a61a-d69b8cee2336 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:49.937159877 +0000 UTC m=+4.069287088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhphv" (UniqueName: "kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv") pod "network-check-target-gmps7" (UID: "7aa7246e-4bbd-4094-a61a-d69b8cee2336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:48:49.252250 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.252156    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:43:48 +0000 UTC" deadline="2028-04-16 14:22:10.372826957 +0000 UTC"
Sep 09 23:48:49.252250 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.252186    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14030h33m21.120644996s"
Sep 09 23:48:49.342968 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.342911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2n8gz" event={"ID":"daf0b287-7915-4114-afcb-cf729ae449bc","Type":"ContainerStarted","Data":"3c2303f738e5ae33e32fdd2dd9e6f52b9861fb0bdfcae011c892829eb74bc683"}
Sep 09 23:48:49.344407 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.344370    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5fgsw" event={"ID":"636c9650-cf74-4c56-8595-afdb6d29702e","Type":"ContainerStarted","Data":"3fc5e51e999d25225122f6ec9580a2302c278e58d79ea5f3bc87e947965016c2"}
Sep 09 23:48:49.345834 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.345799    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqld6" event={"ID":"9f567dc0-4b50-4f89-8c59-6857c128767a","Type":"ContainerStarted","Data":"4e7e760d9cac3adcb389a44001c3280ae4e568e20d7dba47c9d0d0ccaf5b77b6"}
Sep 09 23:48:49.347191 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.347149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-77v6t" event={"ID":"7171a24b-d7c1-415c-a7e3-a88b72df36fb","Type":"ContainerStarted","Data":"228bd261aeca9ca9aadfd7ac66fe022e6eab97dc683db00b8c07c5d195af9893"}
Sep 09 23:48:49.348610 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.348584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wcnhr" event={"ID":"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46","Type":"ContainerStarted","Data":"9a71434908412a98c690d738099be390121806b83acd4516d621673b745c5a96"}
Sep 09 23:48:49.350196 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.350078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m" event={"ID":"02cf0c64-f280-44e2-8fcf-5c96f9d88cef","Type":"ContainerStarted","Data":"f581f748e1887d0c42a537586ea70b6002a3a71d6cc1ee7f9f1f14f5d413178e"}
Sep 09 23:48:49.352352 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.352322    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bzrq" event={"ID":"b5f02aaa-b717-416a-8ff4-b66857a29e63","Type":"ContainerStarted","Data":"189831a1161a8c30230cff1386305bd241da850ff640e2d0795b811e3dd5537b"}
Sep 09 23:48:49.353738 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.353712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw" event={"ID":"1cb6bb82-63cb-486a-a746-0809ba70ad09","Type":"ContainerStarted","Data":"75b4a87680f13614742ddb7f85d42d24601ae0d56e36f7bfda350f664986b555"}
Sep 09 23:48:49.355203 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.355149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7g9v9" event={"ID":"ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89","Type":"ContainerStarted","Data":"263297789ff7ac570fb028cb9d0376db2e627a0d3d5b275d9a7af5d8b73833b8"}
Sep 09 23:48:49.945183 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.945002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:49.945375 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.945249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhphv\" (UniqueName: \"kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv\") pod \"network-check-target-gmps7\" (UID: \"7aa7246e-4bbd-4094-a61a-d69b8cee2336\") " pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:49.945375 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:49.945293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:49.945522 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:49.945135    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:48:49.945522 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:49.945470    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs podName:b6a27c9e-ee55-4d2b-ac35-25b474a89304 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:51.945451035 +0000 UTC m=+6.077578258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs") pod "network-metrics-daemon-pjdw5" (UID: "b6a27c9e-ee55-4d2b-ac35-25b474a89304") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:48:49.945522 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:49.945475    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:48:49.945522 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:49.945491    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:48:49.945522 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:49.945502    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mhphv for pod openshift-network-diagnostics/network-check-target-gmps7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:48:49.945804 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:49.945539    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv podName:7aa7246e-4bbd-4094-a61a-d69b8cee2336 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:51.945525637 +0000 UTC m=+6.077652850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhphv" (UniqueName: "kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv") pod "network-check-target-gmps7" (UID: "7aa7246e-4bbd-4094-a61a-d69b8cee2336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:48:49.945804 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:49.945408    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:48:49.945804 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:49.945580    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret podName:1e350ffb-631f-4f97-ba20-f4b8d39b08e1 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:51.945570647 +0000 UTC m=+6.077697856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret") pod "global-pull-secret-syncer-6lnx6" (UID: "1e350ffb-631f-4f97-ba20-f4b8d39b08e1") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:48:50.253183 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:50.253081    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:43:48 +0000 UTC" deadline="2028-03-16 11:38:19.5804646 +0000 UTC"
Sep 09 23:48:50.253183 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:50.253117    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13283h49m29.327352249s"
Sep 09 23:48:50.334661 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:50.334634    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:50.334828 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:50.334789    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:48:50.335289 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:50.335260    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:50.335419 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:50.335394    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:48:50.335496 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:50.335470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:50.335634 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:50.335576    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:48:51.373910 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:51.373119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal" event={"ID":"29f890174e08c201af11a053bc521344","Type":"ContainerStarted","Data":"b1219b1f036ee1db1389ec29c922bece8677e02875e169f7785e4efe36b43a1e"}
Sep 09 23:48:51.392771 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:51.392736    2560 generic.go:356] "Generic (PLEG): container finished" podID="b61d50ed0606a862d1a406369ed1260e" containerID="73c1a112ffa5b68f00e8216b74702b3a76506f8076c4f271381154ae5591de41" exitCode=0
Sep 09 23:48:51.392930 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:51.392789    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal" event={"ID":"b61d50ed0606a862d1a406369ed1260e","Type":"ContainerDied","Data":"73c1a112ffa5b68f00e8216b74702b3a76506f8076c4f271381154ae5591de41"}
Sep 09 23:48:51.407475 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:51.407414    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal" podStartSLOduration=3.407390844 podStartE2EDuration="3.407390844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:51.388555742 +0000 UTC m=+5.520682975" watchObservedRunningTime="2026-09-09 23:48:51.407390844 +0000 UTC m=+5.539518078"
Sep 09 23:48:51.964814 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:51.964773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:51.964992 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:51.964847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhphv\" (UniqueName: \"kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv\") pod \"network-check-target-gmps7\" (UID: \"7aa7246e-4bbd-4094-a61a-d69b8cee2336\") " pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:51.964992 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:51.964884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:51.965216 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:51.965043    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:48:51.965216 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:51.965109    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret podName:1e350ffb-631f-4f97-ba20-f4b8d39b08e1 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:55.965089254 +0000 UTC m=+10.097216477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret") pod "global-pull-secret-syncer-6lnx6" (UID: "1e350ffb-631f-4f97-ba20-f4b8d39b08e1") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:48:51.965526 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:51.965502    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:48:51.965604 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:51.965562    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs podName:b6a27c9e-ee55-4d2b-ac35-25b474a89304 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:55.965547035 +0000 UTC m=+10.097674245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs") pod "network-metrics-daemon-pjdw5" (UID: "b6a27c9e-ee55-4d2b-ac35-25b474a89304") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:48:51.965676 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:51.965642    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:48:51.965676 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:51.965657    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:48:51.965676 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:51.965669    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mhphv for pod openshift-network-diagnostics/network-check-target-gmps7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:48:51.965838 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:51.965703    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv podName:7aa7246e-4bbd-4094-a61a-d69b8cee2336 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:55.965692199 +0000 UTC m=+10.097819413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhphv" (UniqueName: "kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv") pod "network-check-target-gmps7" (UID: "7aa7246e-4bbd-4094-a61a-d69b8cee2336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:48:52.333698 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:52.333663    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:52.333877 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:52.333805    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:48:52.334656 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:52.334324    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:52.334656 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:52.334439    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:48:52.334656 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:52.334510    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:52.334656 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:52.334602    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:48:54.334266 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:54.334226    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:54.334779 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:54.334372    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:48:54.334851 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:54.334778    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:54.334959 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:54.334895    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:48:54.335067 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:54.335048    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:54.335182 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:54.335159    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:48:56.000696 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:56.000650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:56.001205 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:56.000733    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:56.001205 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:56.000786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhphv\" (UniqueName: \"kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv\") pod \"network-check-target-gmps7\" (UID: \"7aa7246e-4bbd-4094-a61a-d69b8cee2336\") " pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:56.001205 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.000937    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:48:56.001205 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.000960    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:48:56.001205 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.000988    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mhphv for pod openshift-network-diagnostics/network-check-target-gmps7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:48:56.001205 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.001048    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv podName:7aa7246e-4bbd-4094-a61a-d69b8cee2336 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:04.001028594 +0000 UTC m=+18.133155807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhphv" (UniqueName: "kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv") pod "network-check-target-gmps7" (UID: "7aa7246e-4bbd-4094-a61a-d69b8cee2336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:48:56.001205 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.001193    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:48:56.001673 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.001240    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:48:56.001673 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.001246    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs podName:b6a27c9e-ee55-4d2b-ac35-25b474a89304 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:04.00123249 +0000 UTC m=+18.133359712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs") pod "network-metrics-daemon-pjdw5" (UID: "b6a27c9e-ee55-4d2b-ac35-25b474a89304") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:48:56.001673 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.001314    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret podName:1e350ffb-631f-4f97-ba20-f4b8d39b08e1 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:04.001296025 +0000 UTC m=+18.133423232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret") pod "global-pull-secret-syncer-6lnx6" (UID: "1e350ffb-631f-4f97-ba20-f4b8d39b08e1") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:48:56.333620 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:56.333400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:56.333620 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:56.333405    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:56.333620 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.333549    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:48:56.333620 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:56.333559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:56.333976 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.333664    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:48:56.334736 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:56.334707    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:48:58.333448 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:58.333417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:48:58.333903 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:58.333453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:48:58.333903 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:48:58.333417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:48:58.333903 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:58.333557    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:48:58.333903 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:58.333615    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:48:58.333903 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:48:58.333704    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:00.336569 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:00.336534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:00.336569 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:00.336576    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:00.337091 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:00.336646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:00.337091 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:00.336659    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:00.337091 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:00.336739    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:00.337091 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:00.336828    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:02.333889 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:02.333849    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:02.334401 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:02.333849    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:02.334401 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:02.334003    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:02.334401 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:02.334110    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:02.334401 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:02.333857    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:02.334401 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:02.334290    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:04.058985 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:04.058943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:04.059456 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:04.059021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhphv\" (UniqueName: \"kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv\") pod \"network-check-target-gmps7\" (UID: \"7aa7246e-4bbd-4094-a61a-d69b8cee2336\") " pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:04.059456 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:04.059060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:04.059456 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.059093    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:49:04.059456 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.059168    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:49:04.059456 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.059179    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs podName:b6a27c9e-ee55-4d2b-ac35-25b474a89304 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:20.059157305 +0000 UTC m=+34.191284526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs") pod "network-metrics-daemon-pjdw5" (UID: "b6a27c9e-ee55-4d2b-ac35-25b474a89304") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:49:04.059456 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.059222    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:49:04.059456 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.059244    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:49:04.059456 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.059257    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mhphv for pod openshift-network-diagnostics/network-check-target-gmps7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:49:04.059456 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.059230    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret podName:1e350ffb-631f-4f97-ba20-f4b8d39b08e1 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:20.059214577 +0000 UTC m=+34.191341803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret") pod "global-pull-secret-syncer-6lnx6" (UID: "1e350ffb-631f-4f97-ba20-f4b8d39b08e1") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:49:04.059456 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.059328    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv podName:7aa7246e-4bbd-4094-a61a-d69b8cee2336 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:20.059308072 +0000 UTC m=+34.191435286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhphv" (UniqueName: "kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv") pod "network-check-target-gmps7" (UID: "7aa7246e-4bbd-4094-a61a-d69b8cee2336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:49:04.337233 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:04.337119    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:04.337233 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:04.337125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:04.337418 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.337249    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:04.337418 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:04.337255    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:04.337418 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.337340    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:04.337418 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:04.337413    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:06.334400 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:06.334355    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:06.334864 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:06.334473    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:06.334864 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:06.334752    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:06.334864 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:06.334832    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:06.334864 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:06.334862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:06.335100 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:06.334914    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:07.428822 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.428611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7g9v9" event={"ID":"ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89","Type":"ContainerStarted","Data":"fd2e2291584c0f3b336489c47c4badf12d48eb3e5293df8b12cabb1416a772c3"}
Sep 09 23:49:07.430510 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.430488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2n8gz" event={"ID":"daf0b287-7915-4114-afcb-cf729ae449bc","Type":"ContainerStarted","Data":"f2bae3820fd05f7cd9b75333453651a5a425a827e8e18980a3fdba5a8f19f1c6"}
Sep 09 23:49:07.432551 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.432527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5fgsw" event={"ID":"636c9650-cf74-4c56-8595-afdb6d29702e","Type":"ContainerStarted","Data":"2dc142bc0120c9a64888851d7587665a6349b2d95aec2e3b4186be0a3f793c67"}
Sep 09 23:49:07.434166 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.434139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqld6" event={"ID":"9f567dc0-4b50-4f89-8c59-6857c128767a","Type":"ContainerStarted","Data":"e140ebcc9a9fbde9976d71a12ac6b2016f611591d6adfc5fc6db1aa5f8e9c3f7"}
Sep 09 23:49:07.436154 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.436110    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal" event={"ID":"b61d50ed0606a862d1a406369ed1260e","Type":"ContainerStarted","Data":"48004ff3ce1cb9b898e4e2dfb5b49a747d19b7aec9cfa7cf7263b12fc9d888b6"}
Sep 09 23:49:07.437592 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.437573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-77v6t" event={"ID":"7171a24b-d7c1-415c-a7e3-a88b72df36fb","Type":"ContainerStarted","Data":"b9a74cc1b06ccd30e27eafd0c6f8ca5be5dbac028902011b18686fb23f29568c"}
Sep 09 23:49:07.439083 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.439063    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wcnhr" event={"ID":"dcfb2510-a51f-4cc9-bd1d-1d1a80fcbc46","Type":"ContainerStarted","Data":"575e4f5379679f826d52f50270e15830c3aa2183bc7d877f8478e5d5ae40b4eb"}
Sep 09 23:49:07.441085 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.441065    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m" event={"ID":"02cf0c64-f280-44e2-8fcf-5c96f9d88cef","Type":"ContainerStarted","Data":"b70ba5ad62ba327eb4156effb7d0226afbecdd617561e5e454d18abec7f1d9a1"}
Sep 09 23:49:07.441146 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.441125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m" event={"ID":"02cf0c64-f280-44e2-8fcf-5c96f9d88cef","Type":"ContainerStarted","Data":"4383d7ffafa6668d1c36f7674c11c2d9e13bd0f78d995143123af77ec44a4566"}
Sep 09 23:49:07.442459 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.442440    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw" event={"ID":"1cb6bb82-63cb-486a-a746-0809ba70ad09","Type":"ContainerStarted","Data":"bd2d69d4536d55745555dcdbf39bc5342628185bf0ebaaa07d8cc0a727461d4e"}
Sep 09 23:49:07.443067 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.443031    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7g9v9" podStartSLOduration=5.736247864 podStartE2EDuration="20.4430205s" totalImagesPullingTime="14.706772636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:07.442988933 +0000 UTC m=+21.575116160" watchObservedRunningTime="2026-09-09 23:49:07.4430205 +0000 UTC m=+21.575147728"
Sep 09 23:49:07.455833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.455795    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal" podStartSLOduration=19.455782052 podStartE2EDuration="19.455782052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:07.455609946 +0000 UTC m=+21.587737173" watchObservedRunningTime="2026-09-09 23:49:07.455782052 +0000 UTC m=+21.587909279"
Sep 09 23:49:07.487529 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.487413    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wcnhr" podStartSLOduration=1.93107304 podStartE2EDuration="20.487392505s" totalImagesPullingTime="18.556319465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:07.487271166 +0000 UTC m=+21.619398394" watchObservedRunningTime="2026-09-09 23:49:07.487392505 +0000 UTC m=+21.619519733"
Sep 09 23:49:07.503425 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.503375    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5fgsw" podStartSLOduration=1.906289622 podStartE2EDuration="20.503359863s" totalImagesPullingTime="18.597070241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:07.503100902 +0000 UTC m=+21.635228129" watchObservedRunningTime="2026-09-09 23:49:07.503359863 +0000 UTC m=+21.635487091"
Sep 09 23:49:07.523115 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.523066    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2n8gz" podStartSLOduration=5.813694193 podStartE2EDuration="20.523050023s" totalImagesPullingTime="14.70935583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:07.522526431 +0000 UTC m=+21.654653659" watchObservedRunningTime="2026-09-09 23:49:07.523050023 +0000 UTC m=+21.655177287"
Sep 09 23:49:07.535698 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:07.535653    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-77v6t" podStartSLOduration=1.997728521 podStartE2EDuration="20.535638826s" totalImagesPullingTime="18.537910305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:07.535172003 +0000 UTC m=+21.667299251" watchObservedRunningTime="2026-09-09 23:49:07.535638826 +0000 UTC m=+21.667766055"
Sep 09 23:49:08.334180 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:08.334146    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:08.334364 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:08.334253    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:08.334364 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:08.334284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:08.334446 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:08.334145    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:08.334446 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:08.334405    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:08.334550 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:08.334499    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:08.446084 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:08.446056    2560 generic.go:356] "Generic (PLEG): container finished" podID="9f567dc0-4b50-4f89-8c59-6857c128767a" containerID="e140ebcc9a9fbde9976d71a12ac6b2016f611591d6adfc5fc6db1aa5f8e9c3f7" exitCode=0
Sep 09 23:49:08.446758 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:08.446147    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqld6" event={"ID":"9f567dc0-4b50-4f89-8c59-6857c128767a","Type":"ContainerDied","Data":"e140ebcc9a9fbde9976d71a12ac6b2016f611591d6adfc5fc6db1aa5f8e9c3f7"}
Sep 09 23:49:08.449266 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:08.449239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m" event={"ID":"02cf0c64-f280-44e2-8fcf-5c96f9d88cef","Type":"ContainerStarted","Data":"3150913e2373b9fdc2b81bb7dd3607561c02d337ccc1f0dd3a86accf6fee0016"}
Sep 09 23:49:08.449365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:08.449303    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m" event={"ID":"02cf0c64-f280-44e2-8fcf-5c96f9d88cef","Type":"ContainerStarted","Data":"6bfc15b3f7e07755779280f4c130de9ce0e0b0364d5dac20ecab435570b33ba1"}
Sep 09 23:49:08.449365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:08.449337    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m" event={"ID":"02cf0c64-f280-44e2-8fcf-5c96f9d88cef","Type":"ContainerStarted","Data":"6855af790d46ffb04a44cab1427382928813e08f0a72a99bb04928e6693b37a4"}
Sep 09 23:49:08.449365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:08.449365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m" event={"ID":"02cf0c64-f280-44e2-8fcf-5c96f9d88cef","Type":"ContainerStarted","Data":"5049308c1081f5ea9176509fc7b23c0ba3d04769f4d307bd0be5804f87e9dcf4"}
Sep 09 23:49:08.705188 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:08.705160    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 23:49:09.272356 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:09.272221    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:49:08.705180715Z","UUID":"2263231b-b09e-4879-9fe9-7047471ecd76","Handler":null,"Name":"","Endpoint":""}
Sep 09 23:49:09.274153 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:09.274126    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 23:49:09.274278 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:09.274168    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 23:49:09.453545 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:09.453494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bzrq" event={"ID":"b5f02aaa-b717-416a-8ff4-b66857a29e63","Type":"ContainerStarted","Data":"e9591a3e85bef26167520efb3491e867ef8b132e0c86eb1fcd931dec25aeb23d"}
Sep 09 23:49:09.455858 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:09.455825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw" event={"ID":"1cb6bb82-63cb-486a-a746-0809ba70ad09","Type":"ContainerStarted","Data":"af818a7adcb38f1c208402a912e0c61083b237b10537c2dccb1a29a4320a63f2"}
Sep 09 23:49:09.472646 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:09.472596    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7bzrq" podStartSLOduration=7.720047728 podStartE2EDuration="22.472582966s" totalImagesPullingTime="14.752535238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:09.47227581 +0000 UTC m=+23.604403043" watchObservedRunningTime="2026-09-09 23:49:09.472582966 +0000 UTC m=+23.604710194"
Sep 09 23:49:10.334063 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:10.334026    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:10.334063 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:10.334055    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:10.334308 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:10.334026    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:10.334308 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:10.334162    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:10.334308 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:10.334224    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:10.334308 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:10.334287    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:10.459752 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:10.459712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw" event={"ID":"1cb6bb82-63cb-486a-a746-0809ba70ad09","Type":"ContainerStarted","Data":"64ca849ed11416c73bd6e18b76b43a416fe876f82599451edb435e28d06171ff"}
Sep 09 23:49:10.463064 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:10.463035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m" event={"ID":"02cf0c64-f280-44e2-8fcf-5c96f9d88cef","Type":"ContainerStarted","Data":"6a131436d8d61b691fb6454067c8664c0a8d30d5dbec376febca19788d6331da"}
Sep 09 23:49:10.478385 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:10.478332    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjxqw" podStartSLOduration=2.748315127 podStartE2EDuration="23.478310986s" totalImagesPullingTime="20.729995859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:10.477593632 +0000 UTC m=+24.609720860" watchObservedRunningTime="2026-09-09 23:49:10.478310986 +0000 UTC m=+24.610438217"
Sep 09 23:49:11.740594 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:11.740552    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:49:11.741256 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:11.741232    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:49:12.334058 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:12.334023    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:12.334267 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:12.334066    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:12.334267 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:12.334033    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:12.334267 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:12.334166    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:12.334267 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:12.334241    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:12.334478 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:12.334320    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:12.468095 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:12.468066    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:49:12.468586 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:12.468564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7g9v9"
Sep 09 23:49:13.473363 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:13.473113    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m" event={"ID":"02cf0c64-f280-44e2-8fcf-5c96f9d88cef","Type":"ContainerStarted","Data":"05c9c532d69d3194b5aad4d23b348e345c528f7e72541bc6027bc7e03eab1fac"}
Sep 09 23:49:13.473772 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:13.473456    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:49:13.473772 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:13.473510    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:49:13.475045 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:13.475016    2560 generic.go:356] "Generic (PLEG): container finished" podID="9f567dc0-4b50-4f89-8c59-6857c128767a" containerID="a672086a62c5d2e1e4c0a8b105c2cffca800e1f025ec180d5fc742d2bf3c7ea4" exitCode=0
Sep 09 23:49:13.475146 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:13.475097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqld6" event={"ID":"9f567dc0-4b50-4f89-8c59-6857c128767a","Type":"ContainerDied","Data":"a672086a62c5d2e1e4c0a8b105c2cffca800e1f025ec180d5fc742d2bf3c7ea4"}
Sep 09 23:49:13.488432 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:13.488413    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:49:13.502009 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:13.501966    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m" podStartSLOduration=7.89664961 podStartE2EDuration="26.501953102s" totalImagesPullingTime="18.605303492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:13.500370385 +0000 UTC m=+27.632497624" watchObservedRunningTime="2026-09-09 23:49:13.501953102 +0000 UTC m=+27.634080326"
Sep 09 23:49:14.333927 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.333895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:14.334095 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.333969    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:14.334150 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:14.334110    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:14.334521 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.333895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:14.334643 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:14.334619    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:14.336575 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:14.335815    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:14.480151 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.480067    2560 generic.go:356] "Generic (PLEG): container finished" podID="9f567dc0-4b50-4f89-8c59-6857c128767a" containerID="dd3e9dad3199473946066d08eadaeab74251c60a5d89236c1ae1ff7777c02fcb" exitCode=0
Sep 09 23:49:14.480690 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.480151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqld6" event={"ID":"9f567dc0-4b50-4f89-8c59-6857c128767a","Type":"ContainerDied","Data":"dd3e9dad3199473946066d08eadaeab74251c60a5d89236c1ae1ff7777c02fcb"}
Sep 09 23:49:14.480860 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.480839    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:49:14.498093 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.498069    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:49:14.958953 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.958690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gmps7"]
Sep 09 23:49:14.959108 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.959064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:14.959199 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:14.959171    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:14.962204 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.961954    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6lnx6"]
Sep 09 23:49:14.962204 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.962040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:14.962204 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:14.962152    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:14.962701 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.962677    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pjdw5"]
Sep 09 23:49:14.962804 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:14.962779    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:14.962899 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:14.962878    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:15.484694 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:15.484660    2560 generic.go:356] "Generic (PLEG): container finished" podID="9f567dc0-4b50-4f89-8c59-6857c128767a" containerID="e6cd4b830ab3cecefefd3fcf7e0418ea7b272a5c40e087440d9f11190fbca67f" exitCode=0
Sep 09 23:49:15.485204 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:15.484752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqld6" event={"ID":"9f567dc0-4b50-4f89-8c59-6857c128767a","Type":"ContainerDied","Data":"e6cd4b830ab3cecefefd3fcf7e0418ea7b272a5c40e087440d9f11190fbca67f"}
Sep 09 23:49:16.334568 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:16.334534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:16.334744 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:16.334663    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:16.334744 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:16.334717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:16.335291 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:16.335253    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:17.333896 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:17.333863    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:17.334357 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:17.333997    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:18.333457 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:18.333424    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:18.333633 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:18.333424    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:18.333633 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:18.333567    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:49:18.333735 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:18.333641    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lnx6" podUID="1e350ffb-631f-4f97-ba20-f4b8d39b08e1"
Sep 09 23:49:19.334134 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:19.334105    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:19.334489 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:19.334205    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmps7" podUID="7aa7246e-4bbd-4094-a61a-d69b8cee2336"
Sep 09 23:49:19.806717 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:19.806692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:19.892920 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:19.892885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:20.074244 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.074221    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhphv\" (UniqueName: \"kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv\") pod \"network-check-target-gmps7\" (UID: \"7aa7246e-4bbd-4094-a61a-d69b8cee2336\") " pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:20.074492 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.074256    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:20.074492 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.074287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:20.074492 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.074371    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:49:20.074492 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.074428    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs podName:b6a27c9e-ee55-4d2b-ac35-25b474a89304 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:52.074409605 +0000 UTC m=+66.206536841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs") pod "network-metrics-daemon-pjdw5" (UID: "b6a27c9e-ee55-4d2b-ac35-25b474a89304") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:49:20.074492 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.074371    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:49:20.074492 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.074444    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:49:20.074492 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.074463    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:49:20.074492 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.074475    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mhphv for pod openshift-network-diagnostics/network-check-target-gmps7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:49:20.074492 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.074496    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret podName:1e350ffb-631f-4f97-ba20-f4b8d39b08e1 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:52.07447697 +0000 UTC m=+66.206604193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret") pod "global-pull-secret-syncer-6lnx6" (UID: "1e350ffb-631f-4f97-ba20-f4b8d39b08e1") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:49:20.074803 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.074512    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv podName:7aa7246e-4bbd-4094-a61a-d69b8cee2336 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:52.074505382 +0000 UTC m=+66.206632588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhphv" (UniqueName: "kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv") pod "network-check-target-gmps7" (UID: "7aa7246e-4bbd-4094-a61a-d69b8cee2336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:49:20.134737 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.134712    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeReady"
Sep 09 23:49:20.135043 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.134822    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 23:49:20.175589 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.175562    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4g6xz"]
Sep 09 23:49:20.187060 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.187037    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6ps48"]
Sep 09 23:49:20.187187 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.187169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.189629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.189606    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 23:49:20.189945 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.189916    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j4rs2\""
Sep 09 23:49:20.190194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.190160    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 23:49:20.199176 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.199156    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4g6xz"]
Sep 09 23:49:20.199269 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.199236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6ps48"
Sep 09 23:49:20.201786 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.201757    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 23:49:20.202222 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.202071    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kqlfp\""
Sep 09 23:49:20.202308 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.202279    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 23:49:20.202404 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.202380    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 23:49:20.202726 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.202706    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6ps48"]
Sep 09 23:49:20.276237 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.276202    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-config-volume\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.276440 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.276264    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ls8k\" (UniqueName: \"kubernetes.io/projected/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-kube-api-access-9ls8k\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.276440 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.276300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-tmp-dir\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.276440 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.276324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.333590 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.333529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:20.333713 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.333529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:20.336197 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.336176    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 23:49:20.336653 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.336198    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lqch4\""
Sep 09 23:49:20.336653 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.336213    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 23:49:20.377580 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.377550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-config-volume\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.377707 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.377616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b962128-2af7-4357-8058-dbae23fd13f8-cert\") pod \"ingress-canary-6ps48\" (UID: \"2b962128-2af7-4357-8058-dbae23fd13f8\") " pod="openshift-ingress-canary/ingress-canary-6ps48"
Sep 09 23:49:20.377707 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.377662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ls8k\" (UniqueName: \"kubernetes.io/projected/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-kube-api-access-9ls8k\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.377707 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.377695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prmrk\" (UniqueName: \"kubernetes.io/projected/2b962128-2af7-4357-8058-dbae23fd13f8-kube-api-access-prmrk\") pod \"ingress-canary-6ps48\" (UID: \"2b962128-2af7-4357-8058-dbae23fd13f8\") " pod="openshift-ingress-canary/ingress-canary-6ps48"
Sep 09 23:49:20.377833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.377756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-tmp-dir\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.377833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.377788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.377925 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.377878    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:49:20.377977 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.377962    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls podName:3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:20.877945321 +0000 UTC m=+35.010072545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls") pod "dns-default-4g6xz" (UID: "3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0") : secret "dns-default-metrics-tls" not found
Sep 09 23:49:20.378104 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.378083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-tmp-dir\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.378184 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.378166    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-config-volume\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.387384 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.387276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ls8k\" (UniqueName: \"kubernetes.io/projected/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-kube-api-access-9ls8k\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.478269 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.478241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prmrk\" (UniqueName: \"kubernetes.io/projected/2b962128-2af7-4357-8058-dbae23fd13f8-kube-api-access-prmrk\") pod \"ingress-canary-6ps48\" (UID: \"2b962128-2af7-4357-8058-dbae23fd13f8\") " pod="openshift-ingress-canary/ingress-canary-6ps48"
Sep 09 23:49:20.478449 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.478313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b962128-2af7-4357-8058-dbae23fd13f8-cert\") pod \"ingress-canary-6ps48\" (UID: \"2b962128-2af7-4357-8058-dbae23fd13f8\") " pod="openshift-ingress-canary/ingress-canary-6ps48"
Sep 09 23:49:20.480676 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.480653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b962128-2af7-4357-8058-dbae23fd13f8-cert\") pod \"ingress-canary-6ps48\" (UID: \"2b962128-2af7-4357-8058-dbae23fd13f8\") " pod="openshift-ingress-canary/ingress-canary-6ps48"
Sep 09 23:49:20.486790 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.486770    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prmrk\" (UniqueName: \"kubernetes.io/projected/2b962128-2af7-4357-8058-dbae23fd13f8-kube-api-access-prmrk\") pod \"ingress-canary-6ps48\" (UID: \"2b962128-2af7-4357-8058-dbae23fd13f8\") " pod="openshift-ingress-canary/ingress-canary-6ps48"
Sep 09 23:49:20.499035 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.499010    2560 generic.go:356] "Generic (PLEG): container finished" podID="9f567dc0-4b50-4f89-8c59-6857c128767a" containerID="faba3c10d06be57b4f6416b6b27fb68735ac6d4705dca66bf22cb7017035c505" exitCode=0
Sep 09 23:49:20.499137 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.499046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqld6" event={"ID":"9f567dc0-4b50-4f89-8c59-6857c128767a","Type":"ContainerDied","Data":"faba3c10d06be57b4f6416b6b27fb68735ac6d4705dca66bf22cb7017035c505"}
Sep 09 23:49:20.508515 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.508498    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6ps48"
Sep 09 23:49:20.827099 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.827071    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6ps48"]
Sep 09 23:49:20.831273 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:49:20.831243    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b962128_2af7_4357_8058_dbae23fd13f8.slice/crio-8fa94a167eefd84d12efe30234d60bf79bae5c3fce4cfde97608010461ea1d14 WatchSource:0}: Error finding container 8fa94a167eefd84d12efe30234d60bf79bae5c3fce4cfde97608010461ea1d14: Status 404 returned error can't find the container with id 8fa94a167eefd84d12efe30234d60bf79bae5c3fce4cfde97608010461ea1d14
Sep 09 23:49:20.881650 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:20.881595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:20.881739 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.881694    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:49:20.881778 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:20.881750    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls podName:3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:21.881735643 +0000 UTC m=+36.013862849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls") pod "dns-default-4g6xz" (UID: "3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0") : secret "dns-default-metrics-tls" not found
Sep 09 23:49:21.333760 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:21.333723    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:21.336482 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:21.336433    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 23:49:21.336482 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:21.336479    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 23:49:21.337400 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:21.337377    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-df57b\""
Sep 09 23:49:21.505375 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:21.505345    2560 generic.go:356] "Generic (PLEG): container finished" podID="9f567dc0-4b50-4f89-8c59-6857c128767a" containerID="f4843cf6e68f018031dcb7a8fff9f9c524f563cd84040e95b97977b591c499df" exitCode=0
Sep 09 23:49:21.505537 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:21.505426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqld6" event={"ID":"9f567dc0-4b50-4f89-8c59-6857c128767a","Type":"ContainerDied","Data":"f4843cf6e68f018031dcb7a8fff9f9c524f563cd84040e95b97977b591c499df"}
Sep 09 23:49:21.506864 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:21.506841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6ps48" event={"ID":"2b962128-2af7-4357-8058-dbae23fd13f8","Type":"ContainerStarted","Data":"8fa94a167eefd84d12efe30234d60bf79bae5c3fce4cfde97608010461ea1d14"}
Sep 09 23:49:21.888925 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:21.888847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:21.889085 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:21.888993    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:49:21.889085 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:21.889047    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls podName:3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:23.889033684 +0000 UTC m=+38.021160890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls") pod "dns-default-4g6xz" (UID: "3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0") : secret "dns-default-metrics-tls" not found
Sep 09 23:49:22.513044 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:22.513002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqld6" event={"ID":"9f567dc0-4b50-4f89-8c59-6857c128767a","Type":"ContainerStarted","Data":"564c868e9426cddb469ea9875165199f97188cde672de8ba96fe62d9daffd458"}
Sep 09 23:49:22.533281 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:22.533230    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nqld6" podStartSLOduration=6.851549513 podStartE2EDuration="35.533211176s" totalImagesPullingTime="28.681661663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:22.531888218 +0000 UTC m=+36.664015446" watchObservedRunningTime="2026-09-09 23:49:22.533211176 +0000 UTC m=+36.665338406"
Sep 09 23:49:22.652008 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:22.651893    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:22.753279 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:22.753248    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:22.852487 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:22.852408    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:22.953299 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:22.953269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:23.516496 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:23.516196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6ps48" event={"ID":"2b962128-2af7-4357-8058-dbae23fd13f8","Type":"ContainerStarted","Data":"eca0cb5d5711376b6abb637cc28615541f7e70711b85a4777242fae3092e5ca4"}
Sep 09 23:49:23.532757 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:23.532710    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6ps48" podStartSLOduration=1.2521346709999999 podStartE2EDuration="3.532697089s" totalImagesPullingTime="2.280562418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:23.532140568 +0000 UTC m=+37.664267793" watchObservedRunningTime="2026-09-09 23:49:23.532697089 +0000 UTC m=+37.664824309"
Sep 09 23:49:23.905759 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:23.905725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:23.905954 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:23.905853    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:49:23.905954 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:23.905902    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls podName:3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:27.905889733 +0000 UTC m=+42.038016939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls") pod "dns-default-4g6xz" (UID: "3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0") : secret "dns-default-metrics-tls" not found
Sep 09 23:49:25.051165 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:25.051136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:25.110866 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:25.110822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:25.650818 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:25.650786    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:25.714395 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:25.714367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:27.225652 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:27.225616    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:27.934558 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:27.934527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:27.934737 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:27.934690    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:49:27.934783 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:27.934759    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls podName:3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:35.934741647 +0000 UTC m=+50.066868873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls") pod "dns-default-4g6xz" (UID: "3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0") : secret "dns-default-metrics-tls" not found
Sep 09 23:49:28.662828 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:28.662794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:28.763166 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:28.763134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:35.986817 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:35.986771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:35.987317 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:35.986961    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:49:35.987317 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:35.987046    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls podName:3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:51.987023399 +0000 UTC m=+66.119150619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls") pod "dns-default-4g6xz" (UID: "3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0") : secret "dns-default-metrics-tls" not found
Sep 09 23:49:41.665791 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:41.665740    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:41.718230 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:41.718196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:46.497720 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:46.497690    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzg8m"
Sep 09 23:49:46.649869 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:46.649827    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:46.702918 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:46.702883    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:47.621373 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:47.621339    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:47.689754 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:47.689705    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:52.000480 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.000428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:49:52.000881 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:52.000584    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:49:52.000881 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:52.000649    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls podName:3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0 nodeName:}" failed. No retries permitted until 2026-09-09 23:50:24.000632396 +0000 UTC m=+98.132759638 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls") pod "dns-default-4g6xz" (UID: "3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0") : secret "dns-default-metrics-tls" not found
Sep 09 23:49:52.100791 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.100737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhphv\" (UniqueName: \"kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv\") pod \"network-check-target-gmps7\" (UID: \"7aa7246e-4bbd-4094-a61a-d69b8cee2336\") " pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:52.100791 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.100804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:52.101040 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.100857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:49:52.103536 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.103505    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 23:49:52.103672 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.103505    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 23:49:52.103672 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.103593    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 23:49:52.111856 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:52.111831    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 23:49:52.111916 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:49:52.111900    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs podName:b6a27c9e-ee55-4d2b-ac35-25b474a89304 nodeName:}" failed. No retries permitted until 2026-09-09 23:50:56.11188038 +0000 UTC m=+130.244007602 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs") pod "network-metrics-daemon-pjdw5" (UID: "b6a27c9e-ee55-4d2b-ac35-25b474a89304") : secret "metrics-daemon-secret" not found
Sep 09 23:49:52.113754 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.113727    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 23:49:52.114902 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.114883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e350ffb-631f-4f97-ba20-f4b8d39b08e1-original-pull-secret\") pod \"global-pull-secret-syncer-6lnx6\" (UID: \"1e350ffb-631f-4f97-ba20-f4b8d39b08e1\") " pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:52.124609 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.124590    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhphv\" (UniqueName: \"kubernetes.io/projected/7aa7246e-4bbd-4094-a61a-d69b8cee2336-kube-api-access-mhphv\") pod \"network-check-target-gmps7\" (UID: \"7aa7246e-4bbd-4094-a61a-d69b8cee2336\") " pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:52.147653 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.147633    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lnx6"
Sep 09 23:49:52.247164 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.247132    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-df57b\""
Sep 09 23:49:52.255341 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.255286    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:52.412392 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.412363    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6lnx6"]
Sep 09 23:49:52.415605 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:49:52.415583    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e350ffb_631f_4f97_ba20_f4b8d39b08e1.slice/crio-37750fe8155b22cdf0abc1bfadf56fdd98fb4c8587ba06f92674defac5fa4d71 WatchSource:0}: Error finding container 37750fe8155b22cdf0abc1bfadf56fdd98fb4c8587ba06f92674defac5fa4d71: Status 404 returned error can't find the container with id 37750fe8155b22cdf0abc1bfadf56fdd98fb4c8587ba06f92674defac5fa4d71
Sep 09 23:49:52.517747 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.517666    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gmps7"]
Sep 09 23:49:52.520744 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:49:52.520718    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa7246e_4bbd_4094_a61a_d69b8cee2336.slice/crio-8a1c11b48e888701433e1187dc27e8c732c70070def6900f737aa3235751255d WatchSource:0}: Error finding container 8a1c11b48e888701433e1187dc27e8c732c70070def6900f737aa3235751255d: Status 404 returned error can't find the container with id 8a1c11b48e888701433e1187dc27e8c732c70070def6900f737aa3235751255d
Sep 09 23:49:52.582915 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.582881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6lnx6" event={"ID":"1e350ffb-631f-4f97-ba20-f4b8d39b08e1","Type":"ContainerStarted","Data":"37750fe8155b22cdf0abc1bfadf56fdd98fb4c8587ba06f92674defac5fa4d71"}
Sep 09 23:49:52.583893 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:52.583874    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gmps7" event={"ID":"7aa7246e-4bbd-4094-a61a-d69b8cee2336","Type":"ContainerStarted","Data":"8a1c11b48e888701433e1187dc27e8c732c70070def6900f737aa3235751255d"}
Sep 09 23:49:55.311797 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:55.311757    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:55.412066 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:55.411996    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:49:57.597417 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:57.597376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gmps7" event={"ID":"7aa7246e-4bbd-4094-a61a-d69b8cee2336","Type":"ContainerStarted","Data":"05838db78fd3ba3491c7009a54722bd4738bfd383723bf61e288a2d954220a65"}
Sep 09 23:49:57.597817 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:57.597559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:49:57.598875 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:57.598850    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6lnx6" event={"ID":"1e350ffb-631f-4f97-ba20-f4b8d39b08e1","Type":"ContainerStarted","Data":"28dd3d642f81e078e2f0913e11279236c93d7fcce887b4202b30aa8487b0db4d"}
Sep 09 23:49:57.612744 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:57.612703    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gmps7" podStartSLOduration=66.197245456 podStartE2EDuration="1m10.612692026s" totalImagesPullingTime="4.41544657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:57.61203896 +0000 UTC m=+71.744166185" watchObservedRunningTime="2026-09-09 23:49:57.612692026 +0000 UTC m=+71.744819254"
Sep 09 23:49:57.625692 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:49:57.625653    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6lnx6" podStartSLOduration=66.098851952 podStartE2EDuration="1m10.625641625s" totalImagesPullingTime="4.526789673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:57.625162508 +0000 UTC m=+71.757289737" watchObservedRunningTime="2026-09-09 23:49:57.625641625 +0000 UTC m=+71.757768852"
Sep 09 23:50:23.127514 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:23.127396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:50:23.178518 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:23.178489    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:50:24.016353 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:24.016315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:50:24.016533 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:50:24.016437    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:50:24.016533 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:50:24.016501    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls podName:3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0 nodeName:}" failed. No retries permitted until 2026-09-09 23:51:28.016487206 +0000 UTC m=+162.148614411 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls") pod "dns-default-4g6xz" (UID: "3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0") : secret "dns-default-metrics-tls" not found
Sep 09 23:50:26.741965 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.741916    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"]
Sep 09 23:50:26.749474 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.749437    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"
Sep 09 23:50:26.754069 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.754040    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 23:50:26.754204 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.754040    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 23:50:26.754204 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.754040    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 09 23:50:26.754204 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.754186    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 23:50:26.754507 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.754242    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bp6x2\""
Sep 09 23:50:26.755169 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.755144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"]
Sep 09 23:50:26.834735 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.834704    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c189ad6f-c301-4e66-b733-64c6e7ab8e6b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7\" (UID: \"c189ad6f-c301-4e66-b733-64c6e7ab8e6b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"
Sep 09 23:50:26.834735 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.834734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfd9m\" (UniqueName: \"kubernetes.io/projected/c189ad6f-c301-4e66-b733-64c6e7ab8e6b-kube-api-access-jfd9m\") pod \"managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7\" (UID: \"c189ad6f-c301-4e66-b733-64c6e7ab8e6b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"
Sep 09 23:50:26.935498 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.935444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c189ad6f-c301-4e66-b733-64c6e7ab8e6b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7\" (UID: \"c189ad6f-c301-4e66-b733-64c6e7ab8e6b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"
Sep 09 23:50:26.935498 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.935501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfd9m\" (UniqueName: \"kubernetes.io/projected/c189ad6f-c301-4e66-b733-64c6e7ab8e6b-kube-api-access-jfd9m\") pod \"managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7\" (UID: \"c189ad6f-c301-4e66-b733-64c6e7ab8e6b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"
Sep 09 23:50:26.937912 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.937890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c189ad6f-c301-4e66-b733-64c6e7ab8e6b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7\" (UID: \"c189ad6f-c301-4e66-b733-64c6e7ab8e6b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"
Sep 09 23:50:26.944138 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:26.944114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfd9m\" (UniqueName: \"kubernetes.io/projected/c189ad6f-c301-4e66-b733-64c6e7ab8e6b-kube-api-access-jfd9m\") pod \"managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7\" (UID: \"c189ad6f-c301-4e66-b733-64c6e7ab8e6b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"
Sep 09 23:50:27.070399 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:27.070362    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"
Sep 09 23:50:27.335958 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:27.335869    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7"]
Sep 09 23:50:27.339029 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:50:27.339005    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc189ad6f_c301_4e66_b733_64c6e7ab8e6b.slice/crio-c1ca5b0230b590f4b70640a0494394aa553c73524d36f98dad31178f17f1bb6e WatchSource:0}: Error finding container c1ca5b0230b590f4b70640a0494394aa553c73524d36f98dad31178f17f1bb6e: Status 404 returned error can't find the container with id c1ca5b0230b590f4b70640a0494394aa553c73524d36f98dad31178f17f1bb6e
Sep 09 23:50:27.668998 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:27.668909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7" event={"ID":"c189ad6f-c301-4e66-b733-64c6e7ab8e6b","Type":"ContainerStarted","Data":"c1ca5b0230b590f4b70640a0494394aa553c73524d36f98dad31178f17f1bb6e"}
Sep 09 23:50:28.604733 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:28.604698    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gmps7"
Sep 09 23:50:30.678171 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:30.678143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7" event={"ID":"c189ad6f-c301-4e66-b733-64c6e7ab8e6b","Type":"ContainerStarted","Data":"827067fcd864f94d926c56a16df0a5aa6ed2194a0ea43504eef68a6bf81f261a"}
Sep 09 23:50:30.692142 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:30.692060    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7" podStartSLOduration=1.474802744 podStartE2EDuration="4.692032904s" totalImagesPullingTime="3.21723016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:50:30.691621458 +0000 UTC m=+104.823748686" watchObservedRunningTime="2026-09-09 23:50:30.692032904 +0000 UTC m=+104.824160133"
Sep 09 23:50:53.812118 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:53.812084    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:50:56.134777 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:50:56.134728    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:50:56.135194 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:50:56.134880    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 23:50:56.135194 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:50:56.134998    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs podName:b6a27c9e-ee55-4d2b-ac35-25b474a89304 nodeName:}" failed. No retries permitted until 2026-09-09 23:52:58.13498042 +0000 UTC m=+252.267107626 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs") pod "network-metrics-daemon-pjdw5" (UID: "b6a27c9e-ee55-4d2b-ac35-25b474a89304") : secret "metrics-daemon-secret" not found
Sep 09 23:51:23.196994 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:51:23.196949    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4g6xz" podUID="3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0"
Sep 09 23:51:23.343728 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:51:23.343672    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:51:23.805124 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:51:23.805091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:51:28.048838 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:51:28.048795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:51:28.049237 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:51:28.048969    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:51:28.049237 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:51:28.049040    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls podName:3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0 nodeName:}" failed. No retries permitted until 2026-09-09 23:53:30.049022121 +0000 UTC m=+284.181149329 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls") pod "dns-default-4g6xz" (UID: "3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0") : secret "dns-default-metrics-tls" not found
Sep 09 23:51:36.334451 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:51:36.334409    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:52:30.960991 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:30.960955    2560 generic.go:356] "Generic (PLEG): container finished" podID="c189ad6f-c301-4e66-b733-64c6e7ab8e6b" containerID="827067fcd864f94d926c56a16df0a5aa6ed2194a0ea43504eef68a6bf81f261a" exitCode=255
Sep 09 23:52:30.961384 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:30.961001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7" event={"ID":"c189ad6f-c301-4e66-b733-64c6e7ab8e6b","Type":"ContainerDied","Data":"827067fcd864f94d926c56a16df0a5aa6ed2194a0ea43504eef68a6bf81f261a"}
Sep 09 23:52:30.966338 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:30.966284    2560 scope.go:117] "RemoveContainer" containerID="827067fcd864f94d926c56a16df0a5aa6ed2194a0ea43504eef68a6bf81f261a"
Sep 09 23:52:31.965289 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:31.965256    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f6d4fcc64-snzm7" event={"ID":"c189ad6f-c301-4e66-b733-64c6e7ab8e6b","Type":"ContainerStarted","Data":"5a806fbdc0c16f1a69cfb7c9dc300ac129a72a024d205bdd07ab33527f5e534f"}
Sep 09 23:52:52.072014 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.071980    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"]
Sep 09 23:52:52.074720 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.074702    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"]
Sep 09 23:52:52.074850 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.074834    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.077210 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.077191    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-tv6x5"]
Sep 09 23:52:52.077321 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.077304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.077557 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.077445    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 09 23:52:52.077662 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.077596    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 09 23:52:52.077662 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.077620    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 09 23:52:52.077904 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.077886    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:52:52.077971 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.077886    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vkd29\""
Sep 09 23:52:52.079534 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.079509    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dzps9\""
Sep 09 23:52:52.079648 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.079576    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 23:52:52.079877 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.079860    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 23:52:52.080013 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.079997    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-565d5b7686-dcqqw"]
Sep 09 23:52:52.080127 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.080111    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 23:52:52.080190 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.080020    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.080636 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.080621    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:52:52.082357 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.082193    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 09 23:52:52.082704 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.082685    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 09 23:52:52.082797 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.082686    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:52:52.082860 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.082820    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sbwkl\""
Sep 09 23:52:52.082860 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.082849    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.082961 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.082849    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 09 23:52:52.085664 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.085645    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 09 23:52:52.085785 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.085767    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 09 23:52:52.085858 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.085693    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 23:52:52.085950 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.085726    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 09 23:52:52.085950 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.085679    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 23:52:52.086584 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.086535    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"]
Sep 09 23:52:52.086782 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.086768    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 09 23:52:52.086860 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.086774    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4sncs\""
Sep 09 23:52:52.090101 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.090079    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"]
Sep 09 23:52:52.091834 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.091816    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-565d5b7686-dcqqw"]
Sep 09 23:52:52.096170 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.096143    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 09 23:52:52.099560 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.099541    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-tv6x5"]
Sep 09 23:52:52.110952 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.110921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3984effc-4d78-424f-9051-d4ff2351f3d0-config\") pod \"service-ca-operator-859f94c4b-8vs6c\" (UID: \"3984effc-4d78-424f-9051-d4ff2351f3d0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.111028 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.110970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3984effc-4d78-424f-9051-d4ff2351f3d0-serving-cert\") pod \"service-ca-operator-859f94c4b-8vs6c\" (UID: \"3984effc-4d78-424f-9051-d4ff2351f3d0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.111070 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.111055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqp5h\" (UniqueName: \"kubernetes.io/projected/3984effc-4d78-424f-9051-d4ff2351f3d0-kube-api-access-hqp5h\") pod \"service-ca-operator-859f94c4b-8vs6c\" (UID: \"3984effc-4d78-424f-9051-d4ff2351f3d0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.174571 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.174540    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s"]
Sep 09 23:52:52.177469 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.177450    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-696dcc8cbc-vrnbr"]
Sep 09 23:52:52.177583 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.177563    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s"
Sep 09 23:52:52.179917 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.179892    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:52:52.180021 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.179926    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 23:52:52.180102 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.180089    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6wvrl\""
Sep 09 23:52:52.180513 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.180498    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.182765 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.182738    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 23:52:52.182765 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.182750    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 23:52:52.182765 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.182763    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 23:52:52.182952 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.182808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rr4p2\""
Sep 09 23:52:52.186411 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.186390    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s"]
Sep 09 23:52:52.188926 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.188907    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 23:52:52.194135 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.194114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-696dcc8cbc-vrnbr"]
Sep 09 23:52:52.211531 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211512    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqp5h\" (UniqueName: \"kubernetes.io/projected/3984effc-4d78-424f-9051-d4ff2351f3d0-kube-api-access-hqp5h\") pod \"service-ca-operator-859f94c4b-8vs6c\" (UID: \"3984effc-4d78-424f-9051-d4ff2351f3d0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.211612 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adc8c692-e97a-46be-8bac-a7281df3f53c-serving-cert\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.211612 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hsft\" (UniqueName: \"kubernetes.io/projected/fcdf5c12-206b-412c-9710-e39940b8d115-kube-api-access-9hsft\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wx78c\" (UID: \"fcdf5c12-206b-412c-9710-e39940b8d115\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.211612 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211597    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pksqm\" (UniqueName: \"kubernetes.io/projected/adc8c692-e97a-46be-8bac-a7281df3f53c-kube-api-access-pksqm\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.211757 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211660    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3984effc-4d78-424f-9051-d4ff2351f3d0-config\") pod \"service-ca-operator-859f94c4b-8vs6c\" (UID: \"3984effc-4d78-424f-9051-d4ff2351f3d0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.211757 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-default-certificate\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.211838 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3984effc-4d78-424f-9051-d4ff2351f3d0-serving-cert\") pod \"service-ca-operator-859f94c4b-8vs6c\" (UID: \"3984effc-4d78-424f-9051-d4ff2351f3d0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.211838 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.211838 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltkbg\" (UniqueName: \"kubernetes.io/projected/35cca434-76f0-464e-88ad-46d76c8ef6bf-kube-api-access-ltkbg\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.212000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adc8c692-e97a-46be-8bac-a7281df3f53c-trusted-ca\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.212000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fcdf5c12-206b-412c-9710-e39940b8d115-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wx78c\" (UID: \"fcdf5c12-206b-412c-9710-e39940b8d115\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.212000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fcdf5c12-206b-412c-9710-e39940b8d115-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wx78c\" (UID: \"fcdf5c12-206b-412c-9710-e39940b8d115\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.212000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211972    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-stats-auth\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.212000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.211992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.212243 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.212016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adc8c692-e97a-46be-8bac-a7281df3f53c-config\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.212243 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.212172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3984effc-4d78-424f-9051-d4ff2351f3d0-config\") pod \"service-ca-operator-859f94c4b-8vs6c\" (UID: \"3984effc-4d78-424f-9051-d4ff2351f3d0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.213968 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.213948    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3984effc-4d78-424f-9051-d4ff2351f3d0-serving-cert\") pod \"service-ca-operator-859f94c4b-8vs6c\" (UID: \"3984effc-4d78-424f-9051-d4ff2351f3d0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.222326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.222309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqp5h\" (UniqueName: \"kubernetes.io/projected/3984effc-4d78-424f-9051-d4ff2351f3d0-kube-api-access-hqp5h\") pod \"service-ca-operator-859f94c4b-8vs6c\" (UID: \"3984effc-4d78-424f-9051-d4ff2351f3d0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.312449 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pksqm\" (UniqueName: \"kubernetes.io/projected/adc8c692-e97a-46be-8bac-a7281df3f53c-kube-api-access-pksqm\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.312449 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hsft\" (UniqueName: \"kubernetes.io/projected/fcdf5c12-206b-412c-9710-e39940b8d115-kube-api-access-9hsft\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wx78c\" (UID: \"fcdf5c12-206b-412c-9710-e39940b8d115\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.312629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.312629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312493    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd6ts\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-kube-api-access-jd6ts\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.312629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltkbg\" (UniqueName: \"kubernetes.io/projected/35cca434-76f0-464e-88ad-46d76c8ef6bf-kube-api-access-ltkbg\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.312629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-installation-pull-secrets\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.312629 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adc8c692-e97a-46be-8bac-a7281df3f53c-trusted-ca\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.312629 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.312616    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:52:52.812597471 +0000 UTC m=+246.944724681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : configmap references non-existent config key: service-ca.crt
Sep 09 23:52:52.312872 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312665    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fcdf5c12-206b-412c-9710-e39940b8d115-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wx78c\" (UID: \"fcdf5c12-206b-412c-9710-e39940b8d115\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.312872 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.312872 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312707    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adc8c692-e97a-46be-8bac-a7281df3f53c-config\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.312872 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fcdf5c12-206b-412c-9710-e39940b8d115-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wx78c\" (UID: \"fcdf5c12-206b-412c-9710-e39940b8d115\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.312872 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adc8c692-e97a-46be-8bac-a7281df3f53c-serving-cert\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.312872 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.312777    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:52:52.312872 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312777    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-registry-certificates\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.312872 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.312824    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:52:52.812810594 +0000 UTC m=+246.944937817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : secret "router-metrics-certs-default" not found
Sep 09 23:52:52.312872 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.313326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-trusted-ca\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.313326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-default-certificate\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.313326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.312976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-image-registry-private-configuration\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.313326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.313019    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eeeb047e-b87f-4899-9978-7404b9741a09-ca-trust-extracted\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.313326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.313055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-stats-auth\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.313326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.313094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r22mj\" (UniqueName: \"kubernetes.io/projected/b682550c-5cd7-4707-a255-a4324d3695ba-kube-api-access-r22mj\") pod \"volume-data-source-validator-695c895bd6-h8k7s\" (UID: \"b682550c-5cd7-4707-a255-a4324d3695ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s"
Sep 09 23:52:52.313326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.313231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fcdf5c12-206b-412c-9710-e39940b8d115-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wx78c\" (UID: \"fcdf5c12-206b-412c-9710-e39940b8d115\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.313326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.313214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-bound-sa-token\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.313729 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.313440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adc8c692-e97a-46be-8bac-a7281df3f53c-config\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.313729 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.313538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adc8c692-e97a-46be-8bac-a7281df3f53c-trusted-ca\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.315213 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.315190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fcdf5c12-206b-412c-9710-e39940b8d115-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wx78c\" (UID: \"fcdf5c12-206b-412c-9710-e39940b8d115\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.315373 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.315354    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-default-certificate\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.315617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.315597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adc8c692-e97a-46be-8bac-a7281df3f53c-serving-cert\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.315654 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.315610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-stats-auth\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.322542 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.322478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hsft\" (UniqueName: \"kubernetes.io/projected/fcdf5c12-206b-412c-9710-e39940b8d115-kube-api-access-9hsft\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wx78c\" (UID: \"fcdf5c12-206b-412c-9710-e39940b8d115\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.323307 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.323283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pksqm\" (UniqueName: \"kubernetes.io/projected/adc8c692-e97a-46be-8bac-a7281df3f53c-kube-api-access-pksqm\") pod \"console-operator-85b454874b-tv6x5\" (UID: \"adc8c692-e97a-46be-8bac-a7281df3f53c\") " pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.323387 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.323330    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltkbg\" (UniqueName: \"kubernetes.io/projected/35cca434-76f0-464e-88ad-46d76c8ef6bf-kube-api-access-ltkbg\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.337685 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.337665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:52.385473 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.385455    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"
Sep 09 23:52:52.393366 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.393345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"
Sep 09 23:52:52.404035 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.404017    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:52:52.414017 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.413955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-bound-sa-token\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.414077 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.414015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd6ts\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-kube-api-access-jd6ts\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.414208 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.414186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-installation-pull-secrets\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.414299 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.414280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-registry-certificates\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.414357 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.414321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.414357 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.414347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-trusted-ca\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.414457 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.414378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-image-registry-private-configuration\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.414457 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.414419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eeeb047e-b87f-4899-9978-7404b9741a09-ca-trust-extracted\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.414457 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.414438    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:52:52.414457 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.414456    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696dcc8cbc-vrnbr: secret "image-registry-tls" not found
Sep 09 23:52:52.414654 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.414455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r22mj\" (UniqueName: \"kubernetes.io/projected/b682550c-5cd7-4707-a255-a4324d3695ba-kube-api-access-r22mj\") pod \"volume-data-source-validator-695c895bd6-h8k7s\" (UID: \"b682550c-5cd7-4707-a255-a4324d3695ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s"
Sep 09 23:52:52.414654 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.414512    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls podName:eeeb047e-b87f-4899-9978-7404b9741a09 nodeName:}" failed. No retries permitted until 2026-09-09 23:52:52.914490051 +0000 UTC m=+247.046617260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls") pod "image-registry-696dcc8cbc-vrnbr" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09") : secret "image-registry-tls" not found
Sep 09 23:52:52.414945 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.414902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-registry-certificates\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.415027 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.414957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eeeb047e-b87f-4899-9978-7404b9741a09-ca-trust-extracted\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.415526 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.415504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-trusted-ca\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.416861 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.416838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-image-registry-private-configuration\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.417289 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.417271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-installation-pull-secrets\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.422280 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.422237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-bound-sa-token\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.422700 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.422679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd6ts\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-kube-api-access-jd6ts\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.422836 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.422807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r22mj\" (UniqueName: \"kubernetes.io/projected/b682550c-5cd7-4707-a255-a4324d3695ba-kube-api-access-r22mj\") pod \"volume-data-source-validator-695c895bd6-h8k7s\" (UID: \"b682550c-5cd7-4707-a255-a4324d3695ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s"
Sep 09 23:52:52.423828 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.423809    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:52.487307 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.487277    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s"
Sep 09 23:52:52.663849 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.663775    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c"]
Sep 09 23:52:52.664823 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.664779    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c"]
Sep 09 23:52:52.666891 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:52:52.666867    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdf5c12_206b_412c_9710_e39940b8d115.slice/crio-fa0e278d3def21160128a741772717efb4f1f6f20ce9856763423799f6db13ed WatchSource:0}: Error finding container fa0e278d3def21160128a741772717efb4f1f6f20ce9856763423799f6db13ed: Status 404 returned error can't find the container with id fa0e278d3def21160128a741772717efb4f1f6f20ce9856763423799f6db13ed
Sep 09 23:52:52.667279 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:52:52.667257    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3984effc_4d78_424f_9051_d4ff2351f3d0.slice/crio-6f91bb9673f275d681d8abca94a3a0d1e14e4a4d4e3d2e59fe9eb4ae061f38ee WatchSource:0}: Error finding container 6f91bb9673f275d681d8abca94a3a0d1e14e4a4d4e3d2e59fe9eb4ae061f38ee: Status 404 returned error can't find the container with id 6f91bb9673f275d681d8abca94a3a0d1e14e4a4d4e3d2e59fe9eb4ae061f38ee
Sep 09 23:52:52.683626 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.683579    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-tv6x5"]
Sep 09 23:52:52.685725 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:52:52.685702    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc8c692_e97a_46be_8bac_a7281df3f53c.slice/crio-a3f86b81bb097f122e01e75526b5cc68dd5bffbca3b614a0311ccca6a69c4877 WatchSource:0}: Error finding container a3f86b81bb097f122e01e75526b5cc68dd5bffbca3b614a0311ccca6a69c4877: Status 404 returned error can't find the container with id a3f86b81bb097f122e01e75526b5cc68dd5bffbca3b614a0311ccca6a69c4877
Sep 09 23:52:52.754722 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.754691    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s"]
Sep 09 23:52:52.757428 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:52:52.757403    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb682550c_5cd7_4707_a255_a4324d3695ba.slice/crio-c499f9f2dfd4ad1cfaa31d7302ac0a13bd0a237d8aa48a30b790f3ca3d191192 WatchSource:0}: Error finding container c499f9f2dfd4ad1cfaa31d7302ac0a13bd0a237d8aa48a30b790f3ca3d191192: Status 404 returned error can't find the container with id c499f9f2dfd4ad1cfaa31d7302ac0a13bd0a237d8aa48a30b790f3ca3d191192
Sep 09 23:52:52.817326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.817289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.817486 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.817385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:52.817486 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.817444    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:52:52.817591 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.817515    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:52:53.817496682 +0000 UTC m=+247.949623892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : configmap references non-existent config key: service-ca.crt
Sep 09 23:52:52.817591 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.817539    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:52:53.817529162 +0000 UTC m=+247.949656383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : secret "router-metrics-certs-default" not found
Sep 09 23:52:52.918036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:52.917955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:52.918174 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.918095    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:52:52.918174 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.918113    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696dcc8cbc-vrnbr: secret "image-registry-tls" not found
Sep 09 23:52:52.918174 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:52.918164    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls podName:eeeb047e-b87f-4899-9978-7404b9741a09 nodeName:}" failed. No retries permitted until 2026-09-09 23:52:53.918147787 +0000 UTC m=+248.050274993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls") pod "image-registry-696dcc8cbc-vrnbr" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09") : secret "image-registry-tls" not found
Sep 09 23:52:53.014208 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:53.014171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c" event={"ID":"fcdf5c12-206b-412c-9710-e39940b8d115","Type":"ContainerStarted","Data":"fa0e278d3def21160128a741772717efb4f1f6f20ce9856763423799f6db13ed"}
Sep 09 23:52:53.015302 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:53.015272    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" event={"ID":"adc8c692-e97a-46be-8bac-a7281df3f53c","Type":"ContainerStarted","Data":"a3f86b81bb097f122e01e75526b5cc68dd5bffbca3b614a0311ccca6a69c4877"}
Sep 09 23:52:53.016408 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:53.016388    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s" event={"ID":"b682550c-5cd7-4707-a255-a4324d3695ba","Type":"ContainerStarted","Data":"c499f9f2dfd4ad1cfaa31d7302ac0a13bd0a237d8aa48a30b790f3ca3d191192"}
Sep 09 23:52:53.017367 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:53.017345    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c" event={"ID":"3984effc-4d78-424f-9051-d4ff2351f3d0","Type":"ContainerStarted","Data":"6f91bb9673f275d681d8abca94a3a0d1e14e4a4d4e3d2e59fe9eb4ae061f38ee"}
Sep 09 23:52:53.826920 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:53.826527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:53.826920 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:53.826601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:53.826920 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:53.826745    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:52:53.826920 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:53.826803    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:52:55.826785705 +0000 UTC m=+249.958912924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : secret "router-metrics-certs-default" not found
Sep 09 23:52:53.826920 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:53.826854    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:52:55.82684267 +0000 UTC m=+249.958969881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : configmap references non-existent config key: service-ca.crt
Sep 09 23:52:53.927811 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:53.927764    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:53.928115 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:53.928049    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:52:53.928115 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:53.928081    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696dcc8cbc-vrnbr: secret "image-registry-tls" not found
Sep 09 23:52:53.928309 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:53.928141    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls podName:eeeb047e-b87f-4899-9978-7404b9741a09 nodeName:}" failed. No retries permitted until 2026-09-09 23:52:55.928126524 +0000 UTC m=+250.060253735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls") pod "image-registry-696dcc8cbc-vrnbr" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09") : secret "image-registry-tls" not found
Sep 09 23:52:55.026234 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:55.026197    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s" event={"ID":"b682550c-5cd7-4707-a255-a4324d3695ba","Type":"ContainerStarted","Data":"5eefa118568b52a5937a593ba4a896d50d8d766b65976b68e9549d3093afbdbb"}
Sep 09 23:52:55.042916 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:55.042867    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-h8k7s" podStartSLOduration=1.732522253 podStartE2EDuration="3.042852581s" totalImagesPullingTime="1.310330328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:52:55.042100255 +0000 UTC m=+249.174227485" watchObservedRunningTime="2026-09-09 23:52:55.042852581 +0000 UTC m=+249.174979812"
Sep 09 23:52:55.126986 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:55.126948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:55.843857 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:55.843818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:55.844017 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:55.843889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:55.844091 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:55.844037    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:52:55.844160 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:55.844099    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:52:59.844081053 +0000 UTC m=+253.976208258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : secret "router-metrics-certs-default" not found
Sep 09 23:52:55.844228 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:55.844173    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:52:59.844161899 +0000 UTC m=+253.976289119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : configmap references non-existent config key: service-ca.crt
Sep 09 23:52:55.944738 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:55.944693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:55.944891 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:55.944858    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:52:55.944891 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:55.944874    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696dcc8cbc-vrnbr: secret "image-registry-tls" not found
Sep 09 23:52:55.945011 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:55.944947    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls podName:eeeb047e-b87f-4899-9978-7404b9741a09 nodeName:}" failed. No retries permitted until 2026-09-09 23:52:59.944912423 +0000 UTC m=+254.077039659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls") pod "image-registry-696dcc8cbc-vrnbr" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09") : secret "image-registry-tls" not found
Sep 09 23:52:56.030860 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.030792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c" event={"ID":"3984effc-4d78-424f-9051-d4ff2351f3d0","Type":"ContainerStarted","Data":"c31a9a43962215d443bea75a1ce20ca05144ad764723c2871ed9cd045e119f6f"}
Sep 09 23:52:56.032432 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.032399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c" event={"ID":"fcdf5c12-206b-412c-9710-e39940b8d115","Type":"ContainerStarted","Data":"9892948cb0eb61b212884a01c465ccab402ebacbb22d46ff1c2b7a4906fb1c3f"}
Sep 09 23:52:56.034186 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.034167    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/0.log"
Sep 09 23:52:56.034314 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.034202    2560 generic.go:356] "Generic (PLEG): container finished" podID="adc8c692-e97a-46be-8bac-a7281df3f53c" containerID="5c4328df774cb9a11e69f81d3f382825fc90688cffb5403b140b45f232f832bb" exitCode=255
Sep 09 23:52:56.034314 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.034229    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" event={"ID":"adc8c692-e97a-46be-8bac-a7281df3f53c","Type":"ContainerDied","Data":"5c4328df774cb9a11e69f81d3f382825fc90688cffb5403b140b45f232f832bb"}
Sep 09 23:52:56.034532 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.034482    2560 scope.go:117] "RemoveContainer" containerID="5c4328df774cb9a11e69f81d3f382825fc90688cffb5403b140b45f232f832bb"
Sep 09 23:52:56.048274 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.048230    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c" podStartSLOduration=0.966086853 podStartE2EDuration="4.048217614s" totalImagesPullingTime="3.082130761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:52:56.047549688 +0000 UTC m=+250.179676918" watchObservedRunningTime="2026-09-09 23:52:56.048217614 +0000 UTC m=+250.180344841"
Sep 09 23:52:56.052563 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.052542    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8jf24"]
Sep 09 23:52:56.057122 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.057102    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.059391 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.059369    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 23:52:56.059786 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.059765    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 23:52:56.059893 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.059814    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 23:52:56.059893 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.059878    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 23:52:56.060025 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.059963    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2ktz8\""
Sep 09 23:52:56.069341 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.069318    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8jf24"]
Sep 09 23:52:56.089834 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.089789    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c" podStartSLOduration=1.012830076 podStartE2EDuration="4.089772678s" totalImagesPullingTime="3.076942602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:52:56.088878194 +0000 UTC m=+250.221005422" watchObservedRunningTime="2026-09-09 23:52:56.089772678 +0000 UTC m=+250.221899903"
Sep 09 23:52:56.147673 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.146476    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.147673 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.146542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.147673 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.146754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-crio-socket\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.147673 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.146805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-data-volume\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.147673 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.146831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz4nz\" (UniqueName: \"kubernetes.io/projected/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-api-access-mz4nz\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.247282 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.247252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-crio-socket\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.247423 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.247311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-data-volume\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.247423 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.247338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz4nz\" (UniqueName: \"kubernetes.io/projected/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-api-access-mz4nz\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.247423 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.247373    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-crio-socket\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.247423 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.247385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.247630 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.247436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.247630 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:56.247518    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:52:56.247630 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:56.247543    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:52:56.247630 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:56.247589    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:52:56.747569348 +0000 UTC m=+250.879696555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : configmap "kube-rbac-proxy" not found
Sep 09 23:52:56.247630 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:56.247603    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:52:56.747597524 +0000 UTC m=+250.879724731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:52:56.247839 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.247700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-data-volume\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.255723 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.255698    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz4nz\" (UniqueName: \"kubernetes.io/projected/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-api-access-mz4nz\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.452950 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.452901    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:56.752072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.751992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.752208 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:56.752124    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:52:56.752208 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.752173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:56.752208 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:56.752198    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:52:57.752177249 +0000 UTC m=+251.884304469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : configmap "kube-rbac-proxy" not found
Sep 09 23:52:56.752331 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:56.752276    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:52:56.752368 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:56.752345    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:52:57.752327856 +0000 UTC m=+251.884455077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:52:56.935545 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:56.935499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:57.031438 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.031357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:57.039048 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.039026    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/1.log"
Sep 09 23:52:57.039462 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.039446    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/0.log"
Sep 09 23:52:57.039518 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.039480    2560 generic.go:356] "Generic (PLEG): container finished" podID="adc8c692-e97a-46be-8bac-a7281df3f53c" containerID="d92cdf0c2cbcfc52ab2efce08f1936ea7c7e43004a9cda3c207228f994e0b136" exitCode=255
Sep 09 23:52:57.039587 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.039568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" event={"ID":"adc8c692-e97a-46be-8bac-a7281df3f53c","Type":"ContainerDied","Data":"d92cdf0c2cbcfc52ab2efce08f1936ea7c7e43004a9cda3c207228f994e0b136"}
Sep 09 23:52:57.039648 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.039628    2560 scope.go:117] "RemoveContainer" containerID="5c4328df774cb9a11e69f81d3f382825fc90688cffb5403b140b45f232f832bb"
Sep 09 23:52:57.039834 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.039818    2560 scope.go:117] "RemoveContainer" containerID="d92cdf0c2cbcfc52ab2efce08f1936ea7c7e43004a9cda3c207228f994e0b136"
Sep 09 23:52:57.040058 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:57.040024    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-tv6x5_openshift-console-operator(adc8c692-e97a-46be-8bac-a7281df3f53c)\"" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" podUID="adc8c692-e97a-46be-8bac-a7281df3f53c"
Sep 09 23:52:57.085211 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.085159    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:57.358445 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.358400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:57.457286 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.457251    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:57.759035 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.758949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:57.759198 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:57.759071    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:52:57.759198 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.759099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:57.759198 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:57.759157    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:52:59.759140662 +0000 UTC m=+253.891267874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : configmap "kube-rbac-proxy" not found
Sep 09 23:52:57.759354 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:57.759215    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:52:57.759354 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:57.759277    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:52:59.759259654 +0000 UTC m=+253.891386875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:52:57.793722 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.793692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:57.813167 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.813144    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-77v6t_7171a24b-d7c1-415c-a7e3-a88b72df36fb/dns-node-resolver/0.log"
Sep 09 23:52:57.842824 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:57.842793    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:58.044474 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:58.044405    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/1.log"
Sep 09 23:52:58.044828 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:58.044713    2560 scope.go:117] "RemoveContainer" containerID="d92cdf0c2cbcfc52ab2efce08f1936ea7c7e43004a9cda3c207228f994e0b136"
Sep 09 23:52:58.044867 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:58.044849    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-tv6x5_openshift-console-operator(adc8c692-e97a-46be-8bac-a7281df3f53c)\"" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" podUID="adc8c692-e97a-46be-8bac-a7281df3f53c"
Sep 09 23:52:58.061408 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:58.061388    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:58.161827 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:58.161787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:52:58.162020 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:58.161957    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 23:52:58.162091 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:58.162020    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs podName:b6a27c9e-ee55-4d2b-ac35-25b474a89304 nodeName:}" failed. No retries permitted until 2026-09-09 23:55:00.162002573 +0000 UTC m=+374.294129779 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs") pod "network-metrics-daemon-pjdw5" (UID: "b6a27c9e-ee55-4d2b-ac35-25b474a89304") : secret "metrics-daemon-secret" not found
Sep 09 23:52:58.162353 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:58.162330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:58.811924 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:58.811898    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2n8gz_daf0b287-7915-4114-afcb-cf729ae449bc/node-ca/0.log"
Sep 09 23:52:59.162131 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:59.162053    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:59.216678 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:59.216648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:59.616253 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:59.616225    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6ps48_2b962128-2af7-4357-8058-dbae23fd13f8/serve-healthcheck-canary/0.log"
Sep 09 23:52:59.746892 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:59.746833    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:59.775015 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:59.774993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:59.775101 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:59.775025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:52:59.775101 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:59.775095    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:52:59.775171 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:59.775127    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:52:59.775171 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:59.775144    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:53:03.775131386 +0000 UTC m=+257.907258591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : configmap "kube-rbac-proxy" not found
Sep 09 23:52:59.775240 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:59.775171    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:53:03.775159008 +0000 UTC m=+257.907286217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:52:59.797204 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:59.797180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:52:59.875653 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:59.875585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:59.875779 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:59.875708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:52:59.875779 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:59.875725    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:52:59.875779 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:59.875778    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:53:07.875764105 +0000 UTC m=+262.007891311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : secret "router-metrics-certs-default" not found
Sep 09 23:52:59.875918 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:59.875832    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:53:07.875815253 +0000 UTC m=+262.007942476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : configmap references non-existent config key: service-ca.crt
Sep 09 23:52:59.976241 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:52:59.976214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:52:59.976363 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:59.976350    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:52:59.976403 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:59.976366    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696dcc8cbc-vrnbr: secret "image-registry-tls" not found
Sep 09 23:52:59.976436 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:52:59.976412    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls podName:eeeb047e-b87f-4899-9978-7404b9741a09 nodeName:}" failed. No retries permitted until 2026-09-09 23:53:07.976399754 +0000 UTC m=+262.108526959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls") pod "image-registry-696dcc8cbc-vrnbr" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09") : secret "image-registry-tls" not found
Sep 09 23:53:00.464337 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:00.464305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:00.532966 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:00.532919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:00.617887 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:00.617859    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:02.404466 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:02.404388    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:53:02.404466 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:02.404435    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:53:02.404858 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:02.404726    2560 scope.go:117] "RemoveContainer" containerID="d92cdf0c2cbcfc52ab2efce08f1936ea7c7e43004a9cda3c207228f994e0b136"
Sep 09 23:53:02.404896 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:02.404860    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-tv6x5_openshift-console-operator(adc8c692-e97a-46be-8bac-a7281df3f53c)\"" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" podUID="adc8c692-e97a-46be-8bac-a7281df3f53c"
Sep 09 23:53:03.131912 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:03.131875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:03.535302 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:03.535221    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:03.734791 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:03.734764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:03.805752 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:03.805725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:53:03.805893 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:03.805766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:53:03.805893 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:03.805841    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:53:03.805893 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:03.805866    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:53:03.806014 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:03.805904    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:53:11.805886141 +0000 UTC m=+265.938013362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : configmap "kube-rbac-proxy" not found
Sep 09 23:53:03.806014 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:03.805921    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:53:11.805912066 +0000 UTC m=+265.938039272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:53:04.081294 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:04.081160    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:04.181052 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:04.181006    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:04.280897 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:04.280859    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:05.226193 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:05.226163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:05.629545 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:05.629517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:05.831989 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:05.831954    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:06.024422 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:06.024339    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:06.225582 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:06.225554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:07.035450 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:07.035415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:07.222543 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:07.222513    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:07.334036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:07.334008    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:07.430177 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:07.430125    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:07.631604 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:07.631519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:07.829400 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:07.829367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:07.936138 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:07.936053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:07.936138 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:07.936108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:07.936307 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:07.936191    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:53:07.936307 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:07.936234    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:53:23.936216995 +0000 UTC m=+278.068344206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : configmap references non-existent config key: service-ca.crt
Sep 09 23:53:07.936307 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:07.936258    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs podName:35cca434-76f0-464e-88ad-46d76c8ef6bf nodeName:}" failed. No retries permitted until 2026-09-09 23:53:23.936251466 +0000 UTC m=+278.068378672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs") pod "router-default-565d5b7686-dcqqw" (UID: "35cca434-76f0-464e-88ad-46d76c8ef6bf") : secret "router-metrics-certs-default" not found
Sep 09 23:53:08.027226 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:08.027194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:08.037308 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:08.037285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:53:08.039517 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:08.039498    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls\") pod \"image-registry-696dcc8cbc-vrnbr\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") " pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:53:08.093433 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:08.093406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:53:08.223399 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:08.223329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:08.364531 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:08.364503    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-696dcc8cbc-vrnbr"]
Sep 09 23:53:08.367578 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:08.367544    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeeb047e_b87f_4899_9978_7404b9741a09.slice/crio-97496bd63a27ce87c55e4252b38822952cc584ae66c964958bc11b1c0af8f96a WatchSource:0}: Error finding container 97496bd63a27ce87c55e4252b38822952cc584ae66c964958bc11b1c0af8f96a: Status 404 returned error can't find the container with id 97496bd63a27ce87c55e4252b38822952cc584ae66c964958bc11b1c0af8f96a
Sep 09 23:53:09.082470 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:09.082393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr" event={"ID":"eeeb047e-b87f-4899-9978-7404b9741a09","Type":"ContainerStarted","Data":"990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092"}
Sep 09 23:53:09.082470 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:09.082443    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr" event={"ID":"eeeb047e-b87f-4899-9978-7404b9741a09","Type":"ContainerStarted","Data":"97496bd63a27ce87c55e4252b38822952cc584ae66c964958bc11b1c0af8f96a"}
Sep 09 23:53:09.082855 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:09.082538    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:53:09.100838 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:09.100793    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr" podStartSLOduration=17.100778857 podStartE2EDuration="17.100778857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:09.099917962 +0000 UTC m=+263.232045189" watchObservedRunningTime="2026-09-09 23:53:09.100778857 +0000 UTC m=+263.232906085"
Sep 09 23:53:09.239485 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:09.239442    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:09.424110 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:09.424023    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:09.629542 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:09.629513    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:09.830060 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:09.830029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:09.994131 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:09.994084    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:10.042402 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:10.042378    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:10.231023 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:10.230944    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:11.231257 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:11.231230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:11.474188 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:11.474147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:11.634753 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:11.634725    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:11.865632 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:11.865595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:53:11.865632 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:11.865641    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:53:11.865840 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:11.865746    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:53:11.865840 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:11.865808    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls podName:cd7f1ee0-cf47-4989-baf1-cb22b3aadafb nodeName:}" failed. No retries permitted until 2026-09-09 23:53:27.865793635 +0000 UTC m=+281.997920841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jf24" (UID: "cd7f1ee0-cf47-4989-baf1-cb22b3aadafb") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:53:11.866174 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:11.866158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:53:12.058098 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:12.058069    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:12.465845 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:12.465773    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:13.303167 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:13.303137    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:13.334033 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:13.334004    2560 scope.go:117] "RemoveContainer" containerID="d92cdf0c2cbcfc52ab2efce08f1936ea7c7e43004a9cda3c207228f994e0b136"
Sep 09 23:53:13.439447 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:13.439418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:13.710648 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:13.710572    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:13.860642 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:13.860603    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:13.962273 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:13.962193    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:14.060724 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:14.060692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:14.098786 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:14.098757    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 09 23:53:14.099180 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:14.099165    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/1.log"
Sep 09 23:53:14.099232 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:14.099196    2560 generic.go:356] "Generic (PLEG): container finished" podID="adc8c692-e97a-46be-8bac-a7281df3f53c" containerID="02c4c990a7d5746f889f6904d9a6cfffa86f8acb3dca97fc9bab8d2ec0260b83" exitCode=255
Sep 09 23:53:14.099232 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:14.099224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" event={"ID":"adc8c692-e97a-46be-8bac-a7281df3f53c","Type":"ContainerDied","Data":"02c4c990a7d5746f889f6904d9a6cfffa86f8acb3dca97fc9bab8d2ec0260b83"}
Sep 09 23:53:14.099301 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:14.099290    2560 scope.go:117] "RemoveContainer" containerID="d92cdf0c2cbcfc52ab2efce08f1936ea7c7e43004a9cda3c207228f994e0b136"
Sep 09 23:53:14.099567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:14.099552    2560 scope.go:117] "RemoveContainer" containerID="02c4c990a7d5746f889f6904d9a6cfffa86f8acb3dca97fc9bab8d2ec0260b83"
Sep 09 23:53:14.099723 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:14.099705    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-tv6x5_openshift-console-operator(adc8c692-e97a-46be-8bac-a7281df3f53c)\"" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" podUID="adc8c692-e97a-46be-8bac-a7281df3f53c"
Sep 09 23:53:14.304426 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:14.304373    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:15.103294 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:15.103264    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 09 23:53:21.596298 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:21.596264    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-696dcc8cbc-vrnbr"]
Sep 09 23:53:21.666890 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:21.666856    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:21.731283 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:21.731256    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:22.404890 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:22.404843    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:53:22.405130 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:22.404917    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:53:22.405287 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:22.405271    2560 scope.go:117] "RemoveContainer" containerID="02c4c990a7d5746f889f6904d9a6cfffa86f8acb3dca97fc9bab8d2ec0260b83"
Sep 09 23:53:22.405472 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:22.405451    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-tv6x5_openshift-console-operator(adc8c692-e97a-46be-8bac-a7281df3f53c)\"" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" podUID="adc8c692-e97a-46be-8bac-a7281df3f53c"
Sep 09 23:53:23.957305 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:23.957254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:23.957305 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:23.957317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:23.958030 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:23.958007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cca434-76f0-464e-88ad-46d76c8ef6bf-service-ca-bundle\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:23.959529 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:23.959502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35cca434-76f0-464e-88ad-46d76c8ef6bf-metrics-certs\") pod \"router-default-565d5b7686-dcqqw\" (UID: \"35cca434-76f0-464e-88ad-46d76c8ef6bf\") " pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:24.208743 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:24.208658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:24.477852 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:24.477780    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-565d5b7686-dcqqw"]
Sep 09 23:53:24.480942 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:24.480903    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35cca434_76f0_464e_88ad_46d76c8ef6bf.slice/crio-230b8cd0d469f3b658ca88e0c3481d7633950b2f9b7ace4bb375193acdb0c171 WatchSource:0}: Error finding container 230b8cd0d469f3b658ca88e0c3481d7633950b2f9b7ace4bb375193acdb0c171: Status 404 returned error can't find the container with id 230b8cd0d469f3b658ca88e0c3481d7633950b2f9b7ace4bb375193acdb0c171
Sep 09 23:53:25.132708 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:25.132672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-565d5b7686-dcqqw" event={"ID":"35cca434-76f0-464e-88ad-46d76c8ef6bf","Type":"ContainerStarted","Data":"aa39bfdc81832f1725b7c9b63a608c45de3bc7c690ab16ef84e9a86ad18cb75c"}
Sep 09 23:53:25.133116 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:25.132727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-565d5b7686-dcqqw" event={"ID":"35cca434-76f0-464e-88ad-46d76c8ef6bf","Type":"ContainerStarted","Data":"230b8cd0d469f3b658ca88e0c3481d7633950b2f9b7ace4bb375193acdb0c171"}
Sep 09 23:53:25.209541 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:25.209504    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:25.212108 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:25.212078    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:25.228796 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:25.228750    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-565d5b7686-dcqqw" podStartSLOduration=33.228736304 podStartE2EDuration="33.228736304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:25.152589693 +0000 UTC m=+279.284716922" watchObservedRunningTime="2026-09-09 23:53:25.228736304 +0000 UTC m=+279.360863534"
Sep 09 23:53:26.135851 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:26.135822    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:26.137005 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:26.136984    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-565d5b7686-dcqqw"
Sep 09 23:53:26.552603 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:26.552568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:26.654464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:26.654438    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:26.726857 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:26.726830    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:26.806572 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:26.806493    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4g6xz" podUID="3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0"
Sep 09 23:53:26.948908 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:26.948861    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:27.138894 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:27.138805    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:53:27.292994 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:27.292957    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:27.394167 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:27.394089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:27.883597 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:27.883557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:53:27.885822 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:27.885789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd7f1ee0-cf47-4989-baf1-cb22b3aadafb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jf24\" (UID: \"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb\") " pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:53:27.890842 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:27.890816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8jf24"
Sep 09 23:53:28.189845 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:28.189779    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8jf24"]
Sep 09 23:53:28.193082 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:28.193059    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7f1ee0_cf47_4989_baf1_cb22b3aadafb.slice/crio-27d9bd97dd9c8a770cde68cda3327ad3ad652d55f833405d7418bd124a0d6d29 WatchSource:0}: Error finding container 27d9bd97dd9c8a770cde68cda3327ad3ad652d55f833405d7418bd124a0d6d29: Status 404 returned error can't find the container with id 27d9bd97dd9c8a770cde68cda3327ad3ad652d55f833405d7418bd124a0d6d29
Sep 09 23:53:28.374096 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:28.374069    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:29.147574 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.147538    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jf24" event={"ID":"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb","Type":"ContainerStarted","Data":"d02370e33ef2bc259dabf7b83b626f951a0b8a4b2a666c1ad72e4a3bb924ac34"}
Sep 09 23:53:29.147797 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.147596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jf24" event={"ID":"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb","Type":"ContainerStarted","Data":"27d9bd97dd9c8a770cde68cda3327ad3ad652d55f833405d7418bd124a0d6d29"}
Sep 09 23:53:29.732416 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.732388    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:29.763743 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.763664    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"]
Sep 09 23:53:29.766806 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.766782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:29.769240 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.769221    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 23:53:29.770302 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.770278    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 23:53:29.770302 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.770295    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 23:53:29.770436 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.770282    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 23:53:29.770436 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.770377    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b9pr7\""
Sep 09 23:53:29.770436 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.770338    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 23:53:29.773837 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.773818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"]
Sep 09 23:53:29.801662 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.801639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:29.854004 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.853976    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:29.899189 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.899164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/292063f9-30cd-4049-a7a2-9fc3ec249384-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:29.899279 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.899194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/292063f9-30cd-4049-a7a2-9fc3ec249384-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:29.899279 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.899255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8pj\" (UniqueName: \"kubernetes.io/projected/292063f9-30cd-4049-a7a2-9fc3ec249384-kube-api-access-cg8pj\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:29.899385 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:29.899300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/292063f9-30cd-4049-a7a2-9fc3ec249384-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:30.000636 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.000601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8pj\" (UniqueName: \"kubernetes.io/projected/292063f9-30cd-4049-a7a2-9fc3ec249384-kube-api-access-cg8pj\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:30.000794 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.000658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/292063f9-30cd-4049-a7a2-9fc3ec249384-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:30.000794 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.000715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/292063f9-30cd-4049-a7a2-9fc3ec249384-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:30.000794 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.000741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/292063f9-30cd-4049-a7a2-9fc3ec249384-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:30.001426 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.001402    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/292063f9-30cd-4049-a7a2-9fc3ec249384-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:30.003318 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.003293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/292063f9-30cd-4049-a7a2-9fc3ec249384-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:30.003414 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.003300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/292063f9-30cd-4049-a7a2-9fc3ec249384-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:30.007768 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.007743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8pj\" (UniqueName: \"kubernetes.io/projected/292063f9-30cd-4049-a7a2-9fc3ec249384-kube-api-access-cg8pj\") pod \"prometheus-operator-6f4946db56-dkmp7\" (UID: \"292063f9-30cd-4049-a7a2-9fc3ec249384\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:30.075809 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.075775    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"
Sep 09 23:53:30.101193 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.101164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:53:30.103774 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.103728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0-metrics-tls\") pod \"dns-default-4g6xz\" (UID: \"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0\") " pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:53:30.142044 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.142021    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j4rs2\""
Sep 09 23:53:30.150535 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.150505    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:53:30.157660 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.157621    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jf24" event={"ID":"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb","Type":"ContainerStarted","Data":"92cfc9d473407122f12f26a12c4b9c2b6e0c61ff2e5ab1b6f70e729efdd32d34"}
Sep 09 23:53:30.351896 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.351863    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-dkmp7"]
Sep 09 23:53:30.354465 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:30.354435    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292063f9_30cd_4049_a7a2_9fc3ec249384.slice/crio-12b3d2b43c0a7531aed82d60de0c973bf53393bfe1626de6c2ca2a4e75af2351 WatchSource:0}: Error finding container 12b3d2b43c0a7531aed82d60de0c973bf53393bfe1626de6c2ca2a4e75af2351: Status 404 returned error can't find the container with id 12b3d2b43c0a7531aed82d60de0c973bf53393bfe1626de6c2ca2a4e75af2351
Sep 09 23:53:30.432487 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:30.432457    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4g6xz"]
Sep 09 23:53:30.435870 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:30.435845    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2a20d1_8bd4_4578_ac2d_ba93ee0539e0.slice/crio-24a38bf35d5c1bffdb265f8884bfe00526fc13d27ea0634b7d4fe0ebb77ffca3 WatchSource:0}: Error finding container 24a38bf35d5c1bffdb265f8884bfe00526fc13d27ea0634b7d4fe0ebb77ffca3: Status 404 returned error can't find the container with id 24a38bf35d5c1bffdb265f8884bfe00526fc13d27ea0634b7d4fe0ebb77ffca3
Sep 09 23:53:31.166763 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:31.166714    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jf24" event={"ID":"cd7f1ee0-cf47-4989-baf1-cb22b3aadafb","Type":"ContainerStarted","Data":"a8910e1c63e60ab4be6b1a2a376b81308337e52efa1cc01868ec809ba2176ce1"}
Sep 09 23:53:31.168509 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:31.168480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4g6xz" event={"ID":"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0","Type":"ContainerStarted","Data":"24a38bf35d5c1bffdb265f8884bfe00526fc13d27ea0634b7d4fe0ebb77ffca3"}
Sep 09 23:53:31.169985 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:31.169962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7" event={"ID":"292063f9-30cd-4049-a7a2-9fc3ec249384","Type":"ContainerStarted","Data":"12b3d2b43c0a7531aed82d60de0c973bf53393bfe1626de6c2ca2a4e75af2351"}
Sep 09 23:53:31.183420 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:31.183326    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8jf24" podStartSLOduration=32.680733142 podStartE2EDuration="35.183310849s" totalImagesPullingTime="2.502577707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:52:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:31.182775898 +0000 UTC m=+285.314903127" watchObservedRunningTime="2026-09-09 23:53:31.183310849 +0000 UTC m=+285.315438077"
Sep 09 23:53:31.603834 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:31.603793    2560 patch_prober.go:28] interesting pod/image-registry-696dcc8cbc-vrnbr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 23:53:31.604036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:31.603852    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr" podUID="eeeb047e-b87f-4899-9978-7404b9741a09" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 23:53:32.665274 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:32.665204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:33.178722 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:33.178691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4g6xz" event={"ID":"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0","Type":"ContainerStarted","Data":"7df88018888f394120f3a1400019fe2737a668922c477ad303ac3692f47a6964"}
Sep 09 23:53:33.178895 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:33.178741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4g6xz" event={"ID":"3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0","Type":"ContainerStarted","Data":"4983ff87992507ca299ccfa83b5a2823691b7961a7269a2a617891aaa5624666"}
Sep 09 23:53:33.178895 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:33.178802    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:53:33.182657 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:33.182633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7" event={"ID":"292063f9-30cd-4049-a7a2-9fc3ec249384","Type":"ContainerStarted","Data":"33d6c8420c51ea72ecffe874267e089a1dc16935356cdd98e3c72fd91b64f437"}
Sep 09 23:53:33.182771 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:33.182677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7" event={"ID":"292063f9-30cd-4049-a7a2-9fc3ec249384","Type":"ContainerStarted","Data":"fc89ac75c5b6a05e92076a4b52d8c8161edeeb0556be28f2130c480b34f9613b"}
Sep 09 23:53:33.195920 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:33.195880    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4g6xz" podStartSLOduration=251.243329201 podStartE2EDuration="4m13.195867053s" totalImagesPullingTime="1.952537852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:33.194359432 +0000 UTC m=+287.326486673" watchObservedRunningTime="2026-09-09 23:53:33.195867053 +0000 UTC m=+287.327994301"
Sep 09 23:53:33.209296 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:33.209257    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-dkmp7" podStartSLOduration=2.179183655 podStartE2EDuration="4.209244206s" totalImagesPullingTime="2.030060551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:33.20908627 +0000 UTC m=+287.341213498" watchObservedRunningTime="2026-09-09 23:53:33.209244206 +0000 UTC m=+287.341371433"
Sep 09 23:53:34.853612 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:34.853581    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:35.008914 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.008884    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:35.075897 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.075866    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:35.076121 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.076103    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"]
Sep 09 23:53:35.078234 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.078220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.080511 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.080492    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 09 23:53:35.080631 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.080565    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m26vg\""
Sep 09 23:53:35.080757 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.080742    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 09 23:53:35.088480 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.088461    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"]
Sep 09 23:53:35.091548 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.091531    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"]
Sep 09 23:53:35.093671 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.093656    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.095824 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.095808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 23:53:35.096178 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.096163    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4c46v\""
Sep 09 23:53:35.096234 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.096163    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 23:53:35.096234 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.096198    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 23:53:35.104185 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.104134    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"]
Sep 09 23:53:35.110871 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.110852    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qk8f5"]
Sep 09 23:53:35.112854 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.112839    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.120972 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.120955    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 23:53:35.121073 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.121060    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 23:53:35.121118 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.121061    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 23:53:35.121160 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.121119    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kgm5n\""
Sep 09 23:53:35.140767 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.140742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/66553526-7695-422c-8ebf-c578bf5bd458-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.140767 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.140770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp54g\" (UniqueName: \"kubernetes.io/projected/66553526-7695-422c-8ebf-c578bf5bd458-kube-api-access-wp54g\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.140767 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.140796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5plq\" (UniqueName: \"kubernetes.io/projected/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-kube-api-access-v5plq\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.141036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.140819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-wtmp\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.141036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.140845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2015d09d-69b1-49af-95a3-d52877799b19-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.141036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.140888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-tls\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.141036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.140918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66553526-7695-422c-8ebf-c578bf5bd458-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.141036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.140978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-accelerators-collector-config\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.141036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.140997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-textfile\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.141036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.141023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2015d09d-69b1-49af-95a3-d52877799b19-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.141365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.141088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66553526-7695-422c-8ebf-c578bf5bd458-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.141365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.141117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.141365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.141153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-root\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.141365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.141184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/66553526-7695-422c-8ebf-c578bf5bd458-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.141365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.141227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-sys\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.141365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.141253    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66553526-7695-422c-8ebf-c578bf5bd458-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.141365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.141286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg2lc\" (UniqueName: \"kubernetes.io/projected/2015d09d-69b1-49af-95a3-d52877799b19-kube-api-access-jg2lc\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.141365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.141305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2015d09d-69b1-49af-95a3-d52877799b19-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.141365 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.141325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-metrics-client-ca\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.207529 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.207494    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:35.241836 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.241804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-accelerators-collector-config\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.241836 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.241838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-textfile\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242062 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.241858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2015d09d-69b1-49af-95a3-d52877799b19-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.242062 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.241903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66553526-7695-422c-8ebf-c578bf5bd458-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.242170 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242074    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242170 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-root\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242170 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/66553526-7695-422c-8ebf-c578bf5bd458-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.242322 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-sys\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242322 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-root\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242322 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-textfile\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242322 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-sys\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242322 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66553526-7695-422c-8ebf-c578bf5bd458-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.242564 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg2lc\" (UniqueName: \"kubernetes.io/projected/2015d09d-69b1-49af-95a3-d52877799b19-kube-api-access-jg2lc\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.242564 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2015d09d-69b1-49af-95a3-d52877799b19-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.242564 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-metrics-client-ca\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242564 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/66553526-7695-422c-8ebf-c578bf5bd458-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.242564 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp54g\" (UniqueName: \"kubernetes.io/projected/66553526-7695-422c-8ebf-c578bf5bd458-kube-api-access-wp54g\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.242564 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242510    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5plq\" (UniqueName: \"kubernetes.io/projected/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-kube-api-access-v5plq\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242564 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242535    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-wtmp\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242564 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-accelerators-collector-config\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242964 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2015d09d-69b1-49af-95a3-d52877799b19-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.242964 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-tls\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.242964 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66553526-7695-422c-8ebf-c578bf5bd458-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.242964 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.242913    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/66553526-7695-422c-8ebf-c578bf5bd458-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.243177 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.243086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-metrics-client-ca\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.243772 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.243426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-wtmp\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.243772 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.243429    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66553526-7695-422c-8ebf-c578bf5bd458-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.243772 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.243452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/66553526-7695-422c-8ebf-c578bf5bd458-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.243772 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:35.243503    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 23:53:35.243772 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:35.243569    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-tls podName:ae6b8af0-f2c1-40dd-8ead-455d2f869a7d nodeName:}" failed. No retries permitted until 2026-09-09 23:53:35.743550891 +0000 UTC m=+289.875678099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-tls") pod "node-exporter-qk8f5" (UID: "ae6b8af0-f2c1-40dd-8ead-455d2f869a7d") : secret "node-exporter-tls" not found
Sep 09 23:53:35.244134 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.244051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2015d09d-69b1-49af-95a3-d52877799b19-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.244696 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.244663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.244897 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.244874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2015d09d-69b1-49af-95a3-d52877799b19-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.245011 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.245000    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66553526-7695-422c-8ebf-c578bf5bd458-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.245151 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.245133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2015d09d-69b1-49af-95a3-d52877799b19-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.245667 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.245650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66553526-7695-422c-8ebf-c578bf5bd458-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.250887 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.250862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg2lc\" (UniqueName: \"kubernetes.io/projected/2015d09d-69b1-49af-95a3-d52877799b19-kube-api-access-jg2lc\") pod \"openshift-state-metrics-657fd6c54-xjmgf\" (UID: \"2015d09d-69b1-49af-95a3-d52877799b19\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.251250 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.251233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp54g\" (UniqueName: \"kubernetes.io/projected/66553526-7695-422c-8ebf-c578bf5bd458-kube-api-access-wp54g\") pod \"kube-state-metrics-74cb57df7-zwrgv\" (UID: \"66553526-7695-422c-8ebf-c578bf5bd458\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.251595 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.251575    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5plq\" (UniqueName: \"kubernetes.io/projected/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-kube-api-access-v5plq\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.307445 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.307407    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:35.386820 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.386763    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"
Sep 09 23:53:35.402240 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.402217    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"
Sep 09 23:53:35.454642 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.454507    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:35.512983 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.512954    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:35.596155 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.596124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:35.661177 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.661115    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf"]
Sep 09 23:53:35.663908 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:35.663886    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2015d09d_69b1_49af_95a3_d52877799b19.slice/crio-407ad1654cac4112bc23a27e746501df402a6de18571da06fa951351c54b9c51 WatchSource:0}: Error finding container 407ad1654cac4112bc23a27e746501df402a6de18571da06fa951351c54b9c51: Status 404 returned error can't find the container with id 407ad1654cac4112bc23a27e746501df402a6de18571da06fa951351c54b9c51
Sep 09 23:53:35.672583 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.672563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv"]
Sep 09 23:53:35.675264 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:35.675240    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66553526_7695_422c_8ebf_c578bf5bd458.slice/crio-ae2bd6bab5b79c4d9771c716e5f5fd6fcfa0145e1346687da080961fa8c43f92 WatchSource:0}: Error finding container ae2bd6bab5b79c4d9771c716e5f5fd6fcfa0145e1346687da080961fa8c43f92: Status 404 returned error can't find the container with id ae2bd6bab5b79c4d9771c716e5f5fd6fcfa0145e1346687da080961fa8c43f92
Sep 09 23:53:35.724605 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.724571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:35.747076 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.747045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-tls\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:35.749583 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:35.749563    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae6b8af0-f2c1-40dd-8ead-455d2f869a7d-node-exporter-tls\") pod \"node-exporter-qk8f5\" (UID: \"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d\") " pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:36.020898 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:36.020820    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qk8f5"
Sep 09 23:53:36.029981 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:36.029955    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6b8af0_f2c1_40dd_8ead_455d2f869a7d.slice/crio-bd6ed2cda1a7a2a0c59c9fe389f7184de50b7cad5ccff36c2c75a51c00eb1905 WatchSource:0}: Error finding container bd6ed2cda1a7a2a0c59c9fe389f7184de50b7cad5ccff36c2c75a51c00eb1905: Status 404 returned error can't find the container with id bd6ed2cda1a7a2a0c59c9fe389f7184de50b7cad5ccff36c2c75a51c00eb1905
Sep 09 23:53:36.079843 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:36.079814    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:36.144187 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:36.144156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:36.195187 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:36.195155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv" event={"ID":"66553526-7695-422c-8ebf-c578bf5bd458","Type":"ContainerStarted","Data":"ae2bd6bab5b79c4d9771c716e5f5fd6fcfa0145e1346687da080961fa8c43f92"}
Sep 09 23:53:36.197103 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:36.197078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf" event={"ID":"2015d09d-69b1-49af-95a3-d52877799b19","Type":"ContainerStarted","Data":"fd7ff744329398379f14bce92fdb3842442789e3ed378c52c953ffd586bdaf23"}
Sep 09 23:53:36.197209 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:36.197138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf" event={"ID":"2015d09d-69b1-49af-95a3-d52877799b19","Type":"ContainerStarted","Data":"44f2dd1c717f7387e1b6baef8928156a129a36c2a0f9837f3eca8b613e5815cc"}
Sep 09 23:53:36.197209 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:36.197170    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf" event={"ID":"2015d09d-69b1-49af-95a3-d52877799b19","Type":"ContainerStarted","Data":"407ad1654cac4112bc23a27e746501df402a6de18571da06fa951351c54b9c51"}
Sep 09 23:53:36.198177 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:36.198156    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qk8f5" event={"ID":"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d","Type":"ContainerStarted","Data":"bd6ed2cda1a7a2a0c59c9fe389f7184de50b7cad5ccff36c2c75a51c00eb1905"}
Sep 09 23:53:36.336423 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:36.336391    2560 scope.go:117] "RemoveContainer" containerID="02c4c990a7d5746f889f6904d9a6cfffa86f8acb3dca97fc9bab8d2ec0260b83"
Sep 09 23:53:37.017408 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.017374    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:37.204402 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.204376    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 09 23:53:37.204815 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.204484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" event={"ID":"adc8c692-e97a-46be-8bac-a7281df3f53c","Type":"ContainerStarted","Data":"192fa77e94858d68abfd940ff37b1205efa6f462bb4e466a1d8649eccecdb770"}
Sep 09 23:53:37.204908 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.204886    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:53:37.221119 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.221063    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-tv6x5" podStartSLOduration=42.159825786 podStartE2EDuration="45.221050173s" totalImagesPullingTime="3.061224387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:37.21966461 +0000 UTC m=+291.351791839" watchObservedRunningTime="2026-09-09 23:53:37.221050173 +0000 UTC m=+291.353177400"
Sep 09 23:53:37.358546 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.358513    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-tv6x5"
Sep 09 23:53:37.530995 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.530969    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-z9t85"]
Sep 09 23:53:37.533723 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.533703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-z9t85"
Sep 09 23:53:37.536235 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.536139    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dzkcn\""
Sep 09 23:53:37.536358 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.536278    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 23:53:37.536358 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.536316    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 23:53:37.536899 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.536871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:37.544812 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.544794    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-z9t85"]
Sep 09 23:53:37.563854 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.563829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbx6n\" (UniqueName: \"kubernetes.io/projected/abd6d518-ab23-4546-8b79-b774fe81338e-kube-api-access-mbx6n\") pod \"downloads-85d98c998f-z9t85\" (UID: \"abd6d518-ab23-4546-8b79-b774fe81338e\") " pod="openshift-console/downloads-85d98c998f-z9t85"
Sep 09 23:53:37.637627 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.637590    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:37.665257 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.665227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbx6n\" (UniqueName: \"kubernetes.io/projected/abd6d518-ab23-4546-8b79-b774fe81338e-kube-api-access-mbx6n\") pod \"downloads-85d98c998f-z9t85\" (UID: \"abd6d518-ab23-4546-8b79-b774fe81338e\") " pod="openshift-console/downloads-85d98c998f-z9t85"
Sep 09 23:53:37.673512 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.673466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbx6n\" (UniqueName: \"kubernetes.io/projected/abd6d518-ab23-4546-8b79-b774fe81338e-kube-api-access-mbx6n\") pod \"downloads-85d98c998f-z9t85\" (UID: \"abd6d518-ab23-4546-8b79-b774fe81338e\") " pod="openshift-console/downloads-85d98c998f-z9t85"
Sep 09 23:53:37.811147 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.811121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:37.843248 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.843213    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-z9t85"
Sep 09 23:53:37.911971 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:37.911919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:38.028383 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.028342    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:38.103570 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.103538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:38.121557 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.121524    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-z9t85"]
Sep 09 23:53:38.124852 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:38.124829    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd6d518_ab23_4546_8b79_b774fe81338e.slice/crio-41fd8853db368e115183cfb5585a43bb30b5f715d1631480fe4e98dff5fde18d WatchSource:0}: Error finding container 41fd8853db368e115183cfb5585a43bb30b5f715d1631480fe4e98dff5fde18d: Status 404 returned error can't find the container with id 41fd8853db368e115183cfb5585a43bb30b5f715d1631480fe4e98dff5fde18d
Sep 09 23:53:38.210047 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.209970    2560 generic.go:356] "Generic (PLEG): container finished" podID="ae6b8af0-f2c1-40dd-8ead-455d2f869a7d" containerID="d33d2bf4817cd14440543a1f97b4d9859d8e1e329751a707d977e9fb470b20b6" exitCode=0
Sep 09 23:53:38.210406 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.210077    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qk8f5" event={"ID":"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d","Type":"ContainerDied","Data":"d33d2bf4817cd14440543a1f97b4d9859d8e1e329751a707d977e9fb470b20b6"}
Sep 09 23:53:38.212279 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.212244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv" event={"ID":"66553526-7695-422c-8ebf-c578bf5bd458","Type":"ContainerStarted","Data":"18eff5cad01779a90c41d99c7381b6ef93b11a56e0aac35ca57cf674c37db444"}
Sep 09 23:53:38.212396 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.212304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv" event={"ID":"66553526-7695-422c-8ebf-c578bf5bd458","Type":"ContainerStarted","Data":"43f4a8597b47d047fec16516b3ac454a2d9e1b54764ce61fd577ece49cbcd590"}
Sep 09 23:53:38.212396 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.212332    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv" event={"ID":"66553526-7695-422c-8ebf-c578bf5bd458","Type":"ContainerStarted","Data":"4e81373de2b4812568e9ab60b05f094b492530f4a64a62f5a3afe32ca0bafc31"}
Sep 09 23:53:38.214777 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.214758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf" event={"ID":"2015d09d-69b1-49af-95a3-d52877799b19","Type":"ContainerStarted","Data":"44c8aad2b587cee2197d1e985f517b28ece3edf7fde833ac9917724fd4db3644"}
Sep 09 23:53:38.216049 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.216026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-z9t85" event={"ID":"abd6d518-ab23-4546-8b79-b774fe81338e","Type":"ContainerStarted","Data":"41fd8853db368e115183cfb5585a43bb30b5f715d1631480fe4e98dff5fde18d"}
Sep 09 23:53:38.249507 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.249455    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-xjmgf" podStartSLOduration=1.465427702 podStartE2EDuration="3.249441282s" totalImagesPullingTime="1.78401358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:38.247816511 +0000 UTC m=+292.379943735" watchObservedRunningTime="2026-09-09 23:53:38.249441282 +0000 UTC m=+292.381568510"
Sep 09 23:53:38.265961 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.265913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:38.300152 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.300109    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwrgv" podStartSLOduration=1.424778095 podStartE2EDuration="3.300082868s" totalImagesPullingTime="1.875304773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:38.298882545 +0000 UTC m=+292.431009774" watchObservedRunningTime="2026-09-09 23:53:38.300082868 +0000 UTC m=+292.432210099"
Sep 09 23:53:38.350571 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.350537    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:38.616178 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.616148    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:38.674540 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.674506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:38.729355 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.729321    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:38.834031 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.833950    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:38.894671 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:38.894638    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:39.221257 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:39.221171    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:39.222668 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:39.222617    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qk8f5" event={"ID":"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d","Type":"ContainerStarted","Data":"d88d5af2965c59a344c072440da295e9dcd440a44cec92165f97a38d663a2bdb"}
Sep 09 23:53:39.222790 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:39.222684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qk8f5" event={"ID":"ae6b8af0-f2c1-40dd-8ead-455d2f869a7d","Type":"ContainerStarted","Data":"45731efb1c1fe07ed8a03a5a53834c9e382154d6739427e5488ea293a578b79c"}
Sep 09 23:53:39.244439 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:39.244391    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qk8f5" podStartSLOduration=2.645918689 podStartE2EDuration="4.244376178s" totalImagesPullingTime="1.520302166s" totalInitContainerRuntime="78.155323ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:39.242299908 +0000 UTC m=+293.374427137" watchObservedRunningTime="2026-09-09 23:53:39.244376178 +0000 UTC m=+293.376503402"
Sep 09 23:53:39.334986 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:39.334927    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pjdw5" podUID="b6a27c9e-ee55-4d2b-ac35-25b474a89304"
Sep 09 23:53:39.423875 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:39.423843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:39.519675 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:39.519588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:39.638855 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:39.638829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:39.695996 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:39.695963    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:39.860196 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:39.860163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:39.917942 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:39.917906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:40.294789 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.294716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:40.332412 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.332382    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"]
Sep 09 23:53:40.335840 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.335814    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.338743 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.338716    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 09 23:53:40.338864 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.338749    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-whnkx\""
Sep 09 23:53:40.339080 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.339061    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 09 23:53:40.339173 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.339069    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 09 23:53:40.339173 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.339155    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 09 23:53:40.341237 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.341219    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 09 23:53:40.344390 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.344371    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 09 23:53:40.349741 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.349721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"]
Sep 09 23:53:40.393237 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.393208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-secret-telemeter-client\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.393237 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.393238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4a67114-2a19-4f6c-804e-7ae407147262-metrics-client-ca\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.393437 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.393254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a67114-2a19-4f6c-804e-7ae407147262-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.393437 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.393288    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.393437 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.393344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-telemeter-client-tls\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.393437 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.393418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-federate-client-tls\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.393634 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.393464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6xmz\" (UniqueName: \"kubernetes.io/projected/b4a67114-2a19-4f6c-804e-7ae407147262-kube-api-access-b6xmz\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.393634 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.393515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a67114-2a19-4f6c-804e-7ae407147262-serving-certs-ca-bundle\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.494761 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.494726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-secret-telemeter-client\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.494761 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.494763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4a67114-2a19-4f6c-804e-7ae407147262-metrics-client-ca\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.494959 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.494787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a67114-2a19-4f6c-804e-7ae407147262-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.494959 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.494830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.494959 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.494859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-telemeter-client-tls\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.495120 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.495079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-federate-client-tls\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.495171 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.495124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6xmz\" (UniqueName: \"kubernetes.io/projected/b4a67114-2a19-4f6c-804e-7ae407147262-kube-api-access-b6xmz\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.495220 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.495180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a67114-2a19-4f6c-804e-7ae407147262-serving-certs-ca-bundle\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.495597 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.495490    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4a67114-2a19-4f6c-804e-7ae407147262-metrics-client-ca\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.495701 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.495653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a67114-2a19-4f6c-804e-7ae407147262-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.495802 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.495778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a67114-2a19-4f6c-804e-7ae407147262-serving-certs-ca-bundle\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.497395 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.497355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.497566 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.497545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-federate-client-tls\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.497708 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.497691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-secret-telemeter-client\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.497749 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.497716    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4a67114-2a19-4f6c-804e-7ae407147262-telemeter-client-tls\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.503301 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.503280    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6xmz\" (UniqueName: \"kubernetes.io/projected/b4a67114-2a19-4f6c-804e-7ae407147262-kube-api-access-b6xmz\") pod \"telemeter-client-5fb55ccf6b-6dnvm\" (UID: \"b4a67114-2a19-4f6c-804e-7ae407147262\") " pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.646641 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.646602    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"
Sep 09 23:53:40.930526 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:40.930502    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm"]
Sep 09 23:53:40.932695 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:40.932666    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a67114_2a19_4f6c_804e_7ae407147262.slice/crio-44f43386de3cf8fd5b1f5058fd007c6a6bc5c1cda4aa2d77985d5956468035b0 WatchSource:0}: Error finding container 44f43386de3cf8fd5b1f5058fd007c6a6bc5c1cda4aa2d77985d5956468035b0: Status 404 returned error can't find the container with id 44f43386de3cf8fd5b1f5058fd007c6a6bc5c1cda4aa2d77985d5956468035b0
Sep 09 23:53:41.232857 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:41.232770    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm" event={"ID":"b4a67114-2a19-4f6c-804e-7ae407147262","Type":"ContainerStarted","Data":"44f43386de3cf8fd5b1f5058fd007c6a6bc5c1cda4aa2d77985d5956468035b0"}
Sep 09 23:53:41.287601 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:41.287565    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:41.602835 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:41.602803    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:53:43.188903 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:43.188823    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4g6xz"
Sep 09 23:53:43.245724 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:43.245685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm" event={"ID":"b4a67114-2a19-4f6c-804e-7ae407147262","Type":"ContainerStarted","Data":"b94b4e74acbf5b7359f386c5c97c394273070078d57cf70a8b83345466f72660"}
Sep 09 23:53:44.253325 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:44.253229    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm" event={"ID":"b4a67114-2a19-4f6c-804e-7ae407147262","Type":"ContainerStarted","Data":"ae05ba4a8ff7dee543d8b55fdf71c5eceed4aa6a26ac42c2b78851dd2feff295"}
Sep 09 23:53:44.253325 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:44.253304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm" event={"ID":"b4a67114-2a19-4f6c-804e-7ae407147262","Type":"ContainerStarted","Data":"6e6fcc00b00d4d224c89e61e088db8600371cf8ab05611a2bdd724fd39af883f"}
Sep 09 23:53:44.279796 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:44.279751    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fb55ccf6b-6dnvm" podStartSLOduration=1.3386381 podStartE2EDuration="4.279735044s" totalImagesPullingTime="2.941096944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:44.279519918 +0000 UTC m=+298.411647159" watchObservedRunningTime="2026-09-09 23:53:44.279735044 +0000 UTC m=+298.411862309"
Sep 09 23:53:44.300605 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:44.300576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:44.402046 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:44.401992    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:44.501179 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:44.501134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:46.235108 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.235077    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 09 23:53:46.236047 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.236028    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 09 23:53:46.261228 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.261088    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 23:53:46.616076 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.616034    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr" podUID="eeeb047e-b87f-4899-9978-7404b9741a09" containerName="registry" containerID="cri-o://990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092" gracePeriod=30
Sep 09 23:53:46.862879 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.862851    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:53:46.961240 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.961167    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-registry-certificates\") pod \"eeeb047e-b87f-4899-9978-7404b9741a09\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") "
Sep 09 23:53:46.961240 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.961205    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-image-registry-private-configuration\") pod \"eeeb047e-b87f-4899-9978-7404b9741a09\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") "
Sep 09 23:53:46.961240 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.961238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd6ts\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-kube-api-access-jd6ts\") pod \"eeeb047e-b87f-4899-9978-7404b9741a09\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") "
Sep 09 23:53:46.961494 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.961256    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-installation-pull-secrets\") pod \"eeeb047e-b87f-4899-9978-7404b9741a09\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") "
Sep 09 23:53:46.961494 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.961303    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-trusted-ca\") pod \"eeeb047e-b87f-4899-9978-7404b9741a09\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") "
Sep 09 23:53:46.961731 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.961660    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "eeeb047e-b87f-4899-9978-7404b9741a09" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:53:46.961731 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.961694    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls\") pod \"eeeb047e-b87f-4899-9978-7404b9741a09\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") "
Sep 09 23:53:46.961948 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.961742    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "eeeb047e-b87f-4899-9978-7404b9741a09" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:53:46.961948 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.961809    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eeeb047e-b87f-4899-9978-7404b9741a09-ca-trust-extracted\") pod \"eeeb047e-b87f-4899-9978-7404b9741a09\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") "
Sep 09 23:53:46.961948 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.961838    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-bound-sa-token\") pod \"eeeb047e-b87f-4899-9978-7404b9741a09\" (UID: \"eeeb047e-b87f-4899-9978-7404b9741a09\") "
Sep 09 23:53:46.962276 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.962105    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-trusted-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:53:46.962276 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.962124    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eeeb047e-b87f-4899-9978-7404b9741a09-registry-certificates\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:53:46.964036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.964006    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "eeeb047e-b87f-4899-9978-7404b9741a09" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:53:46.964427 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.964401    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "eeeb047e-b87f-4899-9978-7404b9741a09" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:53:46.964596 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.964573    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-kube-api-access-jd6ts" (OuterVolumeSpecName: "kube-api-access-jd6ts") pod "eeeb047e-b87f-4899-9978-7404b9741a09" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09"). InnerVolumeSpecName "kube-api-access-jd6ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:53:46.964663 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.964617    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "eeeb047e-b87f-4899-9978-7404b9741a09" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:53:46.964764 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.964740    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eeeb047e-b87f-4899-9978-7404b9741a09" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:53:46.972492 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:46.972469    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeeb047e-b87f-4899-9978-7404b9741a09-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "eeeb047e-b87f-4899-9978-7404b9741a09" (UID: "eeeb047e-b87f-4899-9978-7404b9741a09"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:53:47.063039 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.063006    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-registry-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:53:47.063039 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.063033    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eeeb047e-b87f-4899-9978-7404b9741a09-ca-trust-extracted\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:53:47.063039 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.063043    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-bound-sa-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:53:47.063243 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.063052    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-image-registry-private-configuration\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:53:47.063243 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.063061    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd6ts\" (UniqueName: \"kubernetes.io/projected/eeeb047e-b87f-4899-9978-7404b9741a09-kube-api-access-jd6ts\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:53:47.063243 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.063069    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eeeb047e-b87f-4899-9978-7404b9741a09-installation-pull-secrets\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:53:47.267323 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.267241    2560 generic.go:356] "Generic (PLEG): container finished" podID="eeeb047e-b87f-4899-9978-7404b9741a09" containerID="990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092" exitCode=0
Sep 09 23:53:47.267323 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.267297    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr"
Sep 09 23:53:47.267807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.267331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr" event={"ID":"eeeb047e-b87f-4899-9978-7404b9741a09","Type":"ContainerDied","Data":"990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092"}
Sep 09 23:53:47.267807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.267428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696dcc8cbc-vrnbr" event={"ID":"eeeb047e-b87f-4899-9978-7404b9741a09","Type":"ContainerDied","Data":"97496bd63a27ce87c55e4252b38822952cc584ae66c964958bc11b1c0af8f96a"}
Sep 09 23:53:47.267807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.267456    2560 scope.go:117] "RemoveContainer" containerID="990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092"
Sep 09 23:53:47.276498 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.276482    2560 scope.go:117] "RemoveContainer" containerID="990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092"
Sep 09 23:53:47.276758 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:53:47.276730    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092\": container with ID starting with 990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092 not found: ID does not exist" containerID="990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092"
Sep 09 23:53:47.276922 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.276766    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092"} err="failed to get container status \"990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092\": rpc error: code = NotFound desc = could not find container \"990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092\": container with ID starting with 990d7152f896649111fc738516c1a9072a6a5cfb4280f67205ddf49ef10b3092 not found: ID does not exist"
Sep 09 23:53:47.293012 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.292987    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-696dcc8cbc-vrnbr"]
Sep 09 23:53:47.297563 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.297540    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-696dcc8cbc-vrnbr"]
Sep 09 23:53:47.325146 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.325091    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:47.425616 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:47.425584    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:48.339318 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:48.339284    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeeb047e-b87f-4899-9978-7404b9741a09" path="/var/lib/kubelet/pods/eeeb047e-b87f-4899-9978-7404b9741a09/volumes"
Sep 09 23:53:49.100492 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.100455    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8548cf78b5-zqzqw"]
Sep 09 23:53:49.100760 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.100745    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeeb047e-b87f-4899-9978-7404b9741a09" containerName="registry"
Sep 09 23:53:49.100836 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.100763    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeeb047e-b87f-4899-9978-7404b9741a09" containerName="registry"
Sep 09 23:53:49.100921 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.100843    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeeb047e-b87f-4899-9978-7404b9741a09" containerName="registry"
Sep 09 23:53:49.104030 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.104006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.106647 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.106617    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 23:53:49.106775 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.106677    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 23:53:49.107668 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.107644    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 23:53:49.107782 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.107684    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 23:53:49.107782 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.107684    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 23:53:49.107782 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.107732    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fl7jn\""
Sep 09 23:53:49.113562 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.113530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8548cf78b5-zqzqw"]
Sep 09 23:53:49.184284 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.184253    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-serving-cert\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.184284 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.184289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-service-ca\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.184541 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.184332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp8tj\" (UniqueName: \"kubernetes.io/projected/d2f01751-06c9-4dca-83eb-60f95ee756d7-kube-api-access-gp8tj\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.184541 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.184440    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-oauth-serving-cert\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.184541 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.184525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-oauth-config\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.184661 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.184562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-config\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.285546 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.285514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-oauth-serving-cert\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.285718 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.285562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-oauth-config\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.285718 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.285581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-config\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.285718 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.285620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-serving-cert\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.285718 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.285648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-service-ca\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.285718 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.285691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp8tj\" (UniqueName: \"kubernetes.io/projected/d2f01751-06c9-4dca-83eb-60f95ee756d7-kube-api-access-gp8tj\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.286420 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.286368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-config\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.286420 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.286379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-oauth-serving-cert\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.286420 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.286385    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-service-ca\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.288382 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.288356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-oauth-config\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.288504 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.288486    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-serving-cert\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.293850 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.293828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp8tj\" (UniqueName: \"kubernetes.io/projected/d2f01751-06c9-4dca-83eb-60f95ee756d7-kube-api-access-gp8tj\") pod \"console-8548cf78b5-zqzqw\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") " pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:49.415758 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:49.415676    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:53:52.835993 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:52.835958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:52.883570 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:52.883533    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:53.334049 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:53.334011    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:53:53.666999 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:53.666871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:53.725443 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:53.725408    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:56.031781 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.031702    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8548cf78b5-zqzqw"]
Sep 09 23:53:56.035418 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:53:56.035385    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f01751_06c9_4dca_83eb_60f95ee756d7.slice/crio-ac577397b199217309482be03702eb63cf07cf8a3a15c55abb660345de37dfea WatchSource:0}: Error finding container ac577397b199217309482be03702eb63cf07cf8a3a15c55abb660345de37dfea: Status 404 returned error can't find the container with id ac577397b199217309482be03702eb63cf07cf8a3a15c55abb660345de37dfea
Sep 09 23:53:56.037865 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.037841    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:53:56.106268 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.106237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:56.166096 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.166060    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:56.308729 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.308681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-z9t85" event={"ID":"abd6d518-ab23-4546-8b79-b774fe81338e","Type":"ContainerStarted","Data":"ffa109fc951a849c8b4a2f36d94f7a95d8a997e62acca0f37c888b71cb152e95"}
Sep 09 23:53:56.308907 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.308751    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-z9t85"
Sep 09 23:53:56.310323 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.310251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8548cf78b5-zqzqw" event={"ID":"d2f01751-06c9-4dca-83eb-60f95ee756d7","Type":"ContainerStarted","Data":"ac577397b199217309482be03702eb63cf07cf8a3a15c55abb660345de37dfea"}
Sep 09 23:53:56.322883 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.322827    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:56.327212 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.327176    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-z9t85"
Sep 09 23:53:56.327336 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.327169    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-z9t85" podStartSLOduration=1.584163825 podStartE2EDuration="19.327151372s" totalImagesPullingTime="17.742987547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:56.325429518 +0000 UTC m=+310.457556749" watchObservedRunningTime="2026-09-09 23:53:56.327151372 +0000 UTC m=+310.459278599"
Sep 09 23:53:56.423428 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:56.423398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:57.244744 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:57.244702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:57.346054 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:57.346003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:58.665657 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:58.665592    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:53:58.771611 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:53:58.771569    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:00.330923 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:00.330888    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8548cf78b5-zqzqw" event={"ID":"d2f01751-06c9-4dca-83eb-60f95ee756d7","Type":"ContainerStarted","Data":"b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3"}
Sep 09 23:54:00.349736 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:00.349689    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8548cf78b5-zqzqw" podStartSLOduration=7.713157268 podStartE2EDuration="11.349671335s" totalImagesPullingTime="3.636514067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:54:00.347273765 +0000 UTC m=+314.479400994" watchObservedRunningTime="2026-09-09 23:54:00.349671335 +0000 UTC m=+314.481798590"
Sep 09 23:54:02.737728 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:02.737687    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:02.790347 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:02.790298    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:06.259683 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:06.259641    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:06.315331 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:06.315270    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:07.980037 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:07.980002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:09.386744 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:09.386709    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8548cf78b5-zqzqw"]
Sep 09 23:54:09.416211 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:09.416172    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:54:09.482546 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:09.482513    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:09.577363 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:09.577327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:10.080581 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:10.080547    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:10.132693 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:10.132666    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:10.480806 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:10.480730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:13.667208 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:13.667175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:13.728882 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:13.728849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:16.393171 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:16.393138    2560 generic.go:356] "Generic (PLEG): container finished" podID="fcdf5c12-206b-412c-9710-e39940b8d115" containerID="9892948cb0eb61b212884a01c465ccab402ebacbb22d46ff1c2b7a4906fb1c3f" exitCode=0
Sep 09 23:54:16.393524 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:16.393212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c" event={"ID":"fcdf5c12-206b-412c-9710-e39940b8d115","Type":"ContainerDied","Data":"9892948cb0eb61b212884a01c465ccab402ebacbb22d46ff1c2b7a4906fb1c3f"}
Sep 09 23:54:16.393524 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:16.393511    2560 scope.go:117] "RemoveContainer" containerID="9892948cb0eb61b212884a01c465ccab402ebacbb22d46ff1c2b7a4906fb1c3f"
Sep 09 23:54:17.399024 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:17.398985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wx78c" event={"ID":"fcdf5c12-206b-412c-9710-e39940b8d115","Type":"ContainerStarted","Data":"53c286d4c06ae94a1d552882ada35ee1290f9c77d24d3a9bde305638b9cdec63"}
Sep 09 23:54:22.417747 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:22.417714    2560 generic.go:356] "Generic (PLEG): container finished" podID="3984effc-4d78-424f-9051-d4ff2351f3d0" containerID="c31a9a43962215d443bea75a1ce20ca05144ad764723c2871ed9cd045e119f6f" exitCode=0
Sep 09 23:54:22.418125 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:22.417779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c" event={"ID":"3984effc-4d78-424f-9051-d4ff2351f3d0","Type":"ContainerDied","Data":"c31a9a43962215d443bea75a1ce20ca05144ad764723c2871ed9cd045e119f6f"}
Sep 09 23:54:22.418125 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:22.418090    2560 scope.go:117] "RemoveContainer" containerID="c31a9a43962215d443bea75a1ce20ca05144ad764723c2871ed9cd045e119f6f"
Sep 09 23:54:23.426349 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:23.426308    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-8vs6c" event={"ID":"3984effc-4d78-424f-9051-d4ff2351f3d0","Type":"ContainerStarted","Data":"fcc5c56bac7b5538ea7329add8b7c202f789b77fbf5557063241bd7fc2102432"}
Sep 09 23:54:34.411015 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.410957    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8548cf78b5-zqzqw" podUID="d2f01751-06c9-4dca-83eb-60f95ee756d7" containerName="console" containerID="cri-o://b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3" gracePeriod=15
Sep 09 23:54:34.676764 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.676701    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:54:34.791246 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.791209    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-service-ca\") pod \"d2f01751-06c9-4dca-83eb-60f95ee756d7\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") "
Sep 09 23:54:34.791436 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.791272    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-config\") pod \"d2f01751-06c9-4dca-83eb-60f95ee756d7\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") "
Sep 09 23:54:34.791436 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.791295    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-oauth-serving-cert\") pod \"d2f01751-06c9-4dca-83eb-60f95ee756d7\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") "
Sep 09 23:54:34.791436 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.791325    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp8tj\" (UniqueName: \"kubernetes.io/projected/d2f01751-06c9-4dca-83eb-60f95ee756d7-kube-api-access-gp8tj\") pod \"d2f01751-06c9-4dca-83eb-60f95ee756d7\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") "
Sep 09 23:54:34.791436 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.791347    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-serving-cert\") pod \"d2f01751-06c9-4dca-83eb-60f95ee756d7\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") "
Sep 09 23:54:34.791436 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.791382    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-oauth-config\") pod \"d2f01751-06c9-4dca-83eb-60f95ee756d7\" (UID: \"d2f01751-06c9-4dca-83eb-60f95ee756d7\") "
Sep 09 23:54:34.791728 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.791700    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2f01751-06c9-4dca-83eb-60f95ee756d7" (UID: "d2f01751-06c9-4dca-83eb-60f95ee756d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:54:34.791782 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.791726    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2f01751-06c9-4dca-83eb-60f95ee756d7" (UID: "d2f01751-06c9-4dca-83eb-60f95ee756d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:54:34.791782 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.791732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-config" (OuterVolumeSpecName: "console-config") pod "d2f01751-06c9-4dca-83eb-60f95ee756d7" (UID: "d2f01751-06c9-4dca-83eb-60f95ee756d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:54:34.793659 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.793626    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f01751-06c9-4dca-83eb-60f95ee756d7-kube-api-access-gp8tj" (OuterVolumeSpecName: "kube-api-access-gp8tj") pod "d2f01751-06c9-4dca-83eb-60f95ee756d7" (UID: "d2f01751-06c9-4dca-83eb-60f95ee756d7"). InnerVolumeSpecName "kube-api-access-gp8tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:54:34.793741 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.793651    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2f01751-06c9-4dca-83eb-60f95ee756d7" (UID: "d2f01751-06c9-4dca-83eb-60f95ee756d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:54:34.793741 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.793694    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2f01751-06c9-4dca-83eb-60f95ee756d7" (UID: "d2f01751-06c9-4dca-83eb-60f95ee756d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:54:34.892300 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.892268    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-config\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:54:34.892300 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.892296    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-oauth-serving-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:54:34.892300 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.892306    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp8tj\" (UniqueName: \"kubernetes.io/projected/d2f01751-06c9-4dca-83eb-60f95ee756d7-kube-api-access-gp8tj\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:54:34.892506 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.892315    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-serving-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:54:34.892506 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.892323    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2f01751-06c9-4dca-83eb-60f95ee756d7-console-oauth-config\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:54:34.892506 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:34.892333    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2f01751-06c9-4dca-83eb-60f95ee756d7-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:54:35.474176 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:35.474141    2560 generic.go:356] "Generic (PLEG): container finished" podID="d2f01751-06c9-4dca-83eb-60f95ee756d7" containerID="b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3" exitCode=0
Sep 09 23:54:35.474638 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:35.474181    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8548cf78b5-zqzqw"
Sep 09 23:54:35.474638 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:35.474216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8548cf78b5-zqzqw" event={"ID":"d2f01751-06c9-4dca-83eb-60f95ee756d7","Type":"ContainerDied","Data":"b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3"}
Sep 09 23:54:35.474638 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:35.474258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8548cf78b5-zqzqw" event={"ID":"d2f01751-06c9-4dca-83eb-60f95ee756d7","Type":"ContainerDied","Data":"ac577397b199217309482be03702eb63cf07cf8a3a15c55abb660345de37dfea"}
Sep 09 23:54:35.474638 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:35.474279    2560 scope.go:117] "RemoveContainer" containerID="b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3"
Sep 09 23:54:35.487901 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:35.487880    2560 scope.go:117] "RemoveContainer" containerID="b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3"
Sep 09 23:54:35.488202 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:54:35.488185    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3\": container with ID starting with b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3 not found: ID does not exist" containerID="b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3"
Sep 09 23:54:35.488271 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:35.488213    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3"} err="failed to get container status \"b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3\": rpc error: code = NotFound desc = could not find container \"b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3\": container with ID starting with b8bd86868910fb456b9bf40318e263547cdcd951966f1bb9b7e903762e27eea3 not found: ID does not exist"
Sep 09 23:54:35.497421 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:35.497399    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8548cf78b5-zqzqw"]
Sep 09 23:54:35.500668 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:35.500643    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8548cf78b5-zqzqw"]
Sep 09 23:54:36.338740 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:36.338705    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2f01751-06c9-4dca-83eb-60f95ee756d7" path="/var/lib/kubelet/pods/d2f01751-06c9-4dca-83eb-60f95ee756d7/volumes"
Sep 09 23:54:51.192529 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:51.192487    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:51.259656 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:51.259608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:56.703545 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:56.703506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:54:56.804471 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:54:56.804437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:00.197059 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:00.197017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:55:00.199362 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:00.199335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6a27c9e-ee55-4d2b-ac35-25b474a89304-metrics-certs\") pod \"network-metrics-daemon-pjdw5\" (UID: \"b6a27c9e-ee55-4d2b-ac35-25b474a89304\") " pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:55:00.237947 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:00.237904    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lqch4\""
Sep 09 23:55:00.245181 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:00.245158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjdw5"
Sep 09 23:55:00.516568 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:00.516492    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pjdw5"]
Sep 09 23:55:00.519196 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:55:00.519168    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a27c9e_ee55_4d2b_ac35_25b474a89304.slice/crio-dc712dc69ac6e2694d5e670ce628e7a88a59ec164e8313505eecbbb2d6bbf883 WatchSource:0}: Error finding container dc712dc69ac6e2694d5e670ce628e7a88a59ec164e8313505eecbbb2d6bbf883: Status 404 returned error can't find the container with id dc712dc69ac6e2694d5e670ce628e7a88a59ec164e8313505eecbbb2d6bbf883
Sep 09 23:55:00.571131 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:00.571101    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjdw5" event={"ID":"b6a27c9e-ee55-4d2b-ac35-25b474a89304","Type":"ContainerStarted","Data":"dc712dc69ac6e2694d5e670ce628e7a88a59ec164e8313505eecbbb2d6bbf883"}
Sep 09 23:55:02.579805 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:02.579767    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjdw5" event={"ID":"b6a27c9e-ee55-4d2b-ac35-25b474a89304","Type":"ContainerStarted","Data":"7edac7404f5e13adc7ae83a631b482dde6699e1c69e63184439aa5a5ee33177b"}
Sep 09 23:55:02.580288 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:02.579846    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjdw5" event={"ID":"b6a27c9e-ee55-4d2b-ac35-25b474a89304","Type":"ContainerStarted","Data":"fd150f4fbcef460432cb943cad22d418c2036ea046ad8d27192bc03716eee780"}
Sep 09 23:55:02.596816 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:02.596772    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pjdw5" podStartSLOduration=374.358513938 podStartE2EDuration="6m15.596758377s" totalImagesPullingTime="1.238244439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:55:02.594778639 +0000 UTC m=+376.726905889" watchObservedRunningTime="2026-09-09 23:55:02.596758377 +0000 UTC m=+376.728885632"
Sep 09 23:55:02.728395 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:02.728367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:02.788184 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:02.788152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:03.109963 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:03.109913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:03.207095 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:03.207065    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:03.634823 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:03.634789    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:03.736064 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:03.736029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:13.690858 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:13.690816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:13.797396 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:13.797363    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:18.998719 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:18.998670    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ff5d7bb9c-x5klv"]
Sep 09 23:55:18.999259 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:18.999138    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f01751-06c9-4dca-83eb-60f95ee756d7" containerName="console"
Sep 09 23:55:18.999259 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:18.999159    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f01751-06c9-4dca-83eb-60f95ee756d7" containerName="console"
Sep 09 23:55:18.999259 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:18.999236    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2f01751-06c9-4dca-83eb-60f95ee756d7" containerName="console"
Sep 09 23:55:19.002122 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.002102    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.004889 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.004859    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 23:55:19.005064 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.004906    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 23:55:19.005064 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.004910    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 23:55:19.006248 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.006224    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 23:55:19.006348 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.006321    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 23:55:19.006412 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.006350    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fl7jn\""
Sep 09 23:55:19.011997 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.011977    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 23:55:19.014911 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.014886    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff5d7bb9c-x5klv"]
Sep 09 23:55:19.040542 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.040509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-trusted-ca-bundle\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.040709 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.040546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-serving-cert\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.040709 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.040571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-service-ca\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.040709 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.040595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-console-config\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.040709 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.040663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l26tj\" (UniqueName: \"kubernetes.io/projected/78d11374-ff92-4014-a618-1b0518812e89-kube-api-access-l26tj\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.040904 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.040730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-oauth-config\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.040904 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.040764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-oauth-serving-cert\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.061332 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.061303    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:19.115628 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.115594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:19.141866 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.141830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-console-config\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.142039 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.141874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l26tj\" (UniqueName: \"kubernetes.io/projected/78d11374-ff92-4014-a618-1b0518812e89-kube-api-access-l26tj\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.142039 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.141913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-oauth-config\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.142039 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.141960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-oauth-serving-cert\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.142039 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.141988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-trusted-ca-bundle\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.142039 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.142014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-serving-cert\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.142290 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.142223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-service-ca\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.142723 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.142695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-console-config\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.142882 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.142719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-oauth-serving-cert\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.142882 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.142811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-service-ca\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.142882 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.142885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-trusted-ca-bundle\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.144542 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.144519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-oauth-config\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.144622 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.144575    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-serving-cert\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.149608 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.149587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l26tj\" (UniqueName: \"kubernetes.io/projected/78d11374-ff92-4014-a618-1b0518812e89-kube-api-access-l26tj\") pod \"console-6ff5d7bb9c-x5klv\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") " pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.193687 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.193650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:19.250752 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.250670    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:19.313840 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.313796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:19.586327 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.586293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff5d7bb9c-x5klv"]
Sep 09 23:55:19.589232 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:55:19.589200    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d11374_ff92_4014_a618_1b0518812e89.slice/crio-d391e12cb11c4e59ec946c5919ec5f553ea88c8e06f88dc4dfb2e26087fbc2f4 WatchSource:0}: Error finding container d391e12cb11c4e59ec946c5919ec5f553ea88c8e06f88dc4dfb2e26087fbc2f4: Status 404 returned error can't find the container with id d391e12cb11c4e59ec946c5919ec5f553ea88c8e06f88dc4dfb2e26087fbc2f4
Sep 09 23:55:19.647248 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.647214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff5d7bb9c-x5klv" event={"ID":"78d11374-ff92-4014-a618-1b0518812e89","Type":"ContainerStarted","Data":"8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e"}
Sep 09 23:55:19.647373 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.647273    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff5d7bb9c-x5klv" event={"ID":"78d11374-ff92-4014-a618-1b0518812e89","Type":"ContainerStarted","Data":"d391e12cb11c4e59ec946c5919ec5f553ea88c8e06f88dc4dfb2e26087fbc2f4"}
Sep 09 23:55:19.665826 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.665775    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ff5d7bb9c-x5klv" podStartSLOduration=1.665755063 podStartE2EDuration="1.665755063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:55:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:55:19.665469576 +0000 UTC m=+393.797596805" watchObservedRunningTime="2026-09-09 23:55:19.665755063 +0000 UTC m=+393.797882294"
Sep 09 23:55:19.802522 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.802488    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:19.904120 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:19.904039    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:29.314533 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:29.314489    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:29.315004 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:29.314562    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:29.319248 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:29.319226    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:29.694067 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:29.693990    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:55:29.850738 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:29.850703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:29.955130 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:29.955055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:30.006430 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:30.006387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:34.709724 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:34.709689    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:34.808686 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:34.808655    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:42.140253 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:42.140215    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:42.240955 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:42.240900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:56.395125 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:56.395087    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:57.189448 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:57.189412    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:55:59.996897 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:55:59.996863    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:00.055031 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:00.055002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:02.178163 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:02.178132    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:02.264138 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:02.264101    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:03.367740 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:03.367709    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:03.469908 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:03.469879    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:04.303905 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:04.303871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:04.718403 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:04.718324    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:06.823986 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:06.823955    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:06.884870 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:06.884830    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:10.283771 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.283688    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-thlvx"]
Sep 09 23:56:10.285659 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.285641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx"
Sep 09 23:56:10.288201 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.288180    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 23:56:10.289221 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.289201    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 23:56:10.289344 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.289220    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-crz9x\""
Sep 09 23:56:10.296817 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.296773    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-thlvx"]
Sep 09 23:56:10.333846 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.333821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/347c6971-478f-406f-bea5-cbc6e53ddf46-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-thlvx\" (UID: \"347c6971-478f-406f-bea5-cbc6e53ddf46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx"
Sep 09 23:56:10.333974 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.333855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nqt5\" (UniqueName: \"kubernetes.io/projected/347c6971-478f-406f-bea5-cbc6e53ddf46-kube-api-access-5nqt5\") pod \"cert-manager-webhook-6486ffd997-thlvx\" (UID: \"347c6971-478f-406f-bea5-cbc6e53ddf46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx"
Sep 09 23:56:10.435163 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.435137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/347c6971-478f-406f-bea5-cbc6e53ddf46-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-thlvx\" (UID: \"347c6971-478f-406f-bea5-cbc6e53ddf46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx"
Sep 09 23:56:10.435301 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.435169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nqt5\" (UniqueName: \"kubernetes.io/projected/347c6971-478f-406f-bea5-cbc6e53ddf46-kube-api-access-5nqt5\") pod \"cert-manager-webhook-6486ffd997-thlvx\" (UID: \"347c6971-478f-406f-bea5-cbc6e53ddf46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx"
Sep 09 23:56:10.443393 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.443357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/347c6971-478f-406f-bea5-cbc6e53ddf46-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-thlvx\" (UID: \"347c6971-478f-406f-bea5-cbc6e53ddf46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx"
Sep 09 23:56:10.443495 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.443468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nqt5\" (UniqueName: \"kubernetes.io/projected/347c6971-478f-406f-bea5-cbc6e53ddf46-kube-api-access-5nqt5\") pod \"cert-manager-webhook-6486ffd997-thlvx\" (UID: \"347c6971-478f-406f-bea5-cbc6e53ddf46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx"
Sep 09 23:56:10.596814 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.596780    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx"
Sep 09 23:56:10.862168 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:10.862144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-thlvx"]
Sep 09 23:56:10.864691 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:56:10.864667    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod347c6971_478f_406f_bea5_cbc6e53ddf46.slice/crio-05e1369c99ff7fd51b0e238595a00559448f8ce1d5c9f9b92cb5b87201265daa WatchSource:0}: Error finding container 05e1369c99ff7fd51b0e238595a00559448f8ce1d5c9f9b92cb5b87201265daa: Status 404 returned error can't find the container with id 05e1369c99ff7fd51b0e238595a00559448f8ce1d5c9f9b92cb5b87201265daa
Sep 09 23:56:11.858010 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:11.857944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx" event={"ID":"347c6971-478f-406f-bea5-cbc6e53ddf46","Type":"ContainerStarted","Data":"05e1369c99ff7fd51b0e238595a00559448f8ce1d5c9f9b92cb5b87201265daa"}
Sep 09 23:56:12.916214 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:12.916178    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:13.867433 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:13.867400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx" event={"ID":"347c6971-478f-406f-bea5-cbc6e53ddf46","Type":"ContainerStarted","Data":"bab96dbb420a78813355059986f1e9b3da4a83bbb6947d548749a5e0eee6fc26"}
Sep 09 23:56:13.867607 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:13.867458    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx"
Sep 09 23:56:13.882801 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:13.882753    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx" podStartSLOduration=1.042546001 podStartE2EDuration="3.88273788s" totalImagesPullingTime="2.840191879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:56:13.881693028 +0000 UTC m=+448.013820279" watchObservedRunningTime="2026-09-09 23:56:13.88273788 +0000 UTC m=+448.014865108"
Sep 09 23:56:13.944814 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:13.944781    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:13.996459 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:13.996385    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:15.081858 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:15.081823    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:15.182639 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:15.182605    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:16.907098 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:16.907065    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"]
Sep 09 23:56:16.909331 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:16.909308    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"
Sep 09 23:56:16.911836 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:16.911817    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 23:56:16.912982 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:16.912964    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:56:16.912982 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:16.912973    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ftx2m\""
Sep 09 23:56:16.918319 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:16.918298    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"]
Sep 09 23:56:16.989091 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:16.989060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25j4q\" (UniqueName: \"kubernetes.io/projected/06b28ca2-52cb-4b1c-8be6-eb0e49df1840-kube-api-access-25j4q\") pod \"openshift-lws-operator-fd8ccff4c-k7wdx\" (UID: \"06b28ca2-52cb-4b1c-8be6-eb0e49df1840\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"
Sep 09 23:56:16.989225 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:16.989119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06b28ca2-52cb-4b1c-8be6-eb0e49df1840-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k7wdx\" (UID: \"06b28ca2-52cb-4b1c-8be6-eb0e49df1840\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"
Sep 09 23:56:17.090238 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:17.090204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06b28ca2-52cb-4b1c-8be6-eb0e49df1840-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k7wdx\" (UID: \"06b28ca2-52cb-4b1c-8be6-eb0e49df1840\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"
Sep 09 23:56:17.090393 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:17.090251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25j4q\" (UniqueName: \"kubernetes.io/projected/06b28ca2-52cb-4b1c-8be6-eb0e49df1840-kube-api-access-25j4q\") pod \"openshift-lws-operator-fd8ccff4c-k7wdx\" (UID: \"06b28ca2-52cb-4b1c-8be6-eb0e49df1840\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"
Sep 09 23:56:17.090600 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:17.090580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06b28ca2-52cb-4b1c-8be6-eb0e49df1840-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k7wdx\" (UID: \"06b28ca2-52cb-4b1c-8be6-eb0e49df1840\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"
Sep 09 23:56:17.098252 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:17.098223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25j4q\" (UniqueName: \"kubernetes.io/projected/06b28ca2-52cb-4b1c-8be6-eb0e49df1840-kube-api-access-25j4q\") pod \"openshift-lws-operator-fd8ccff4c-k7wdx\" (UID: \"06b28ca2-52cb-4b1c-8be6-eb0e49df1840\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"
Sep 09 23:56:17.219967 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:17.219883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"
Sep 09 23:56:17.485220 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:17.485052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx"]
Sep 09 23:56:17.487467 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:56:17.487443    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06b28ca2_52cb_4b1c_8be6_eb0e49df1840.slice/crio-5de7e20159249d1be44cf52fb1fc73c79662247788fa8f333a59d3d204aff9be WatchSource:0}: Error finding container 5de7e20159249d1be44cf52fb1fc73c79662247788fa8f333a59d3d204aff9be: Status 404 returned error can't find the container with id 5de7e20159249d1be44cf52fb1fc73c79662247788fa8f333a59d3d204aff9be
Sep 09 23:56:17.886268 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:17.886238    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx" event={"ID":"06b28ca2-52cb-4b1c-8be6-eb0e49df1840","Type":"ContainerStarted","Data":"5de7e20159249d1be44cf52fb1fc73c79662247788fa8f333a59d3d204aff9be"}
Sep 09 23:56:19.873228 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:19.873198    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-thlvx"
Sep 09 23:56:20.901635 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:20.901592    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx" event={"ID":"06b28ca2-52cb-4b1c-8be6-eb0e49df1840","Type":"ContainerStarted","Data":"f854361425d43d29399c33125b6bf9257e7e807ff22cb666f7bfd06ea4003d4c"}
Sep 09 23:56:20.917026 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:20.916827    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k7wdx" podStartSLOduration=2.49917481 podStartE2EDuration="4.916809921s" totalImagesPullingTime="2.417635111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:56:20.916622789 +0000 UTC m=+455.048750018" watchObservedRunningTime="2026-09-09 23:56:20.916809921 +0000 UTC m=+455.048937141"
Sep 09 23:56:21.589690 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:21.589660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:21.690503 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:21.690471    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:23.839545 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:23.839504    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:36.446550 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:36.446514    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:36.566565 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:36.566528    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:37.036828 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.036798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:37.249946 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.249897    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:37.348119 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.348078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:37.462340 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.462307    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"]
Sep 09 23:56:37.540804 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.540766    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"]
Sep 09 23:56:37.540980 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.540888    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.543740 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.543716    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 23:56:37.543898 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.543741    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 23:56:37.543898 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.543856    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 23:56:37.543898 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.543886    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5zk9m\""
Sep 09 23:56:37.544083 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.543957    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 23:56:37.643803 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.643708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:37.655970 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.655914    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e612a9c-f096-44a0-b074-de1146008b0c-tmp\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.656091 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.655981    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9hl4\" (UniqueName: \"kubernetes.io/projected/3e612a9c-f096-44a0-b074-de1146008b0c-kube-api-access-t9hl4\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.656091 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.656021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e612a9c-f096-44a0-b074-de1146008b0c-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.656091 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.656078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e612a9c-f096-44a0-b074-de1146008b0c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.656206 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.656105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e612a9c-f096-44a0-b074-de1146008b0c-manifests\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.744301 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.744266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:37.756601 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.756564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e612a9c-f096-44a0-b074-de1146008b0c-tmp\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.756769 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.756609    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9hl4\" (UniqueName: \"kubernetes.io/projected/3e612a9c-f096-44a0-b074-de1146008b0c-kube-api-access-t9hl4\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.756769 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.756649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e612a9c-f096-44a0-b074-de1146008b0c-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.756769 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.756733    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e612a9c-f096-44a0-b074-de1146008b0c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.756942 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.756772    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e612a9c-f096-44a0-b074-de1146008b0c-manifests\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.757226 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.757200    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e612a9c-f096-44a0-b074-de1146008b0c-manifests\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.759159 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.759128    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e612a9c-f096-44a0-b074-de1146008b0c-tmp\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.759249 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.759188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e612a9c-f096-44a0-b074-de1146008b0c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.759381 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.759363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e612a9c-f096-44a0-b074-de1146008b0c-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.766352 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.766323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9hl4\" (UniqueName: \"kubernetes.io/projected/3e612a9c-f096-44a0-b074-de1146008b0c-kube-api-access-t9hl4\") pod \"opendatahub-operator-controller-manager-54cfd54796-cz2sf\" (UID: \"3e612a9c-f096-44a0-b074-de1146008b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.836420 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.836384    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:37.851482 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.851452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:37.894787 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.894717    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:37.960446 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:37.960406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:38.039452 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:38.039416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:38.110352 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:38.110317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:38.144153 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:38.144134    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"]
Sep 09 23:56:38.147187 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:56:38.147126    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e612a9c_f096_44a0_b074_de1146008b0c.slice/crio-d8270fbb01aaca527440e1ab6204f0bf24be6fc1d8dfed797a6860ec89991599 WatchSource:0}: Error finding container d8270fbb01aaca527440e1ab6204f0bf24be6fc1d8dfed797a6860ec89991599: Status 404 returned error can't find the container with id d8270fbb01aaca527440e1ab6204f0bf24be6fc1d8dfed797a6860ec89991599
Sep 09 23:56:38.975790 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:38.975740    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf" event={"ID":"3e612a9c-f096-44a0-b074-de1146008b0c","Type":"ContainerStarted","Data":"d8270fbb01aaca527440e1ab6204f0bf24be6fc1d8dfed797a6860ec89991599"}
Sep 09 23:56:41.991947 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:41.991893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf" event={"ID":"3e612a9c-f096-44a0-b074-de1146008b0c","Type":"ContainerStarted","Data":"defc0d9fc7a24a61b96b497b503d82aa35f46fdc160bf8732cd770eb8b84553f"}
Sep 09 23:56:42.997386 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:42.997349    2560 generic.go:356] "Generic (PLEG): container finished" podID="3e612a9c-f096-44a0-b074-de1146008b0c" containerID="defc0d9fc7a24a61b96b497b503d82aa35f46fdc160bf8732cd770eb8b84553f" exitCode=0
Sep 09 23:56:42.997880 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:42.997442    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf" event={"ID":"3e612a9c-f096-44a0-b074-de1146008b0c","Type":"ContainerDied","Data":"defc0d9fc7a24a61b96b497b503d82aa35f46fdc160bf8732cd770eb8b84553f"}
Sep 09 23:56:44.003375 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:44.003340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf" event={"ID":"3e612a9c-f096-44a0-b074-de1146008b0c","Type":"ContainerStarted","Data":"c5aaef3ccf7767b953b6b50e4c2066c9792a9b68e6a9390cc6d774b3244631b1"}
Sep 09 23:56:44.003757 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:44.003489    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:44.028145 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:44.028088    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf" podStartSLOduration=2.4649415279999998 podStartE2EDuration="7.028073906s" totalImagesPullingTime="3.502242579s" totalInitContainerRuntime="1.060889799s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:56:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:56:44.027208306 +0000 UTC m=+478.159335533" watchObservedRunningTime="2026-09-09 23:56:44.028073906 +0000 UTC m=+478.160201134"
Sep 09 23:56:45.063734 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:45.063703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:45.185429 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:45.185393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:49.668893 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:49.668857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:49.778620 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:49.778582    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:55.010190 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:55.010157    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54cfd54796-cz2sf"
Sep 09 23:56:57.602232 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:57.602199    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:57.706649 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:57.706611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:57.871833 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:57.871728    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:57.879755 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:57.879725    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"]
Sep 09 23:56:57.888481 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:57.888456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:57.890882 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:57.890854    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 23:56:57.891223 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:57.891203    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 23:56:57.892691 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:57.892654    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"]
Sep 09 23:56:58.027231 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.027194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-tmp\") pod \"kube-auth-proxy-7fbcb8d956-mmjvl\" (UID: \"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82\") " pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:58.027231 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.027234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-tls-certs\") pod \"kube-auth-proxy-7fbcb8d956-mmjvl\" (UID: \"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82\") " pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:58.027444 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.027312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjkw8\" (UniqueName: \"kubernetes.io/projected/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-kube-api-access-kjkw8\") pod \"kube-auth-proxy-7fbcb8d956-mmjvl\" (UID: \"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82\") " pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:58.127980 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.127859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-tmp\") pod \"kube-auth-proxy-7fbcb8d956-mmjvl\" (UID: \"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82\") " pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:58.127980 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.127896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-tls-certs\") pod \"kube-auth-proxy-7fbcb8d956-mmjvl\" (UID: \"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82\") " pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:58.127980 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.127959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjkw8\" (UniqueName: \"kubernetes.io/projected/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-kube-api-access-kjkw8\") pod \"kube-auth-proxy-7fbcb8d956-mmjvl\" (UID: \"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82\") " pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:58.128213 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:56:58.128092    2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 09 23:56:58.128213 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:56:58.128169    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-tls-certs podName:2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82 nodeName:}" failed. No retries permitted until 2026-09-09 23:56:58.628153927 +0000 UTC m=+492.760281133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-tls-certs") pod "kube-auth-proxy-7fbcb8d956-mmjvl" (UID: "2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82") : secret "kube-auth-proxy-tls" not found
Sep 09 23:56:58.130125 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.130104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-tmp\") pod \"kube-auth-proxy-7fbcb8d956-mmjvl\" (UID: \"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82\") " pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:58.138584 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.138561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjkw8\" (UniqueName: \"kubernetes.io/projected/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-kube-api-access-kjkw8\") pod \"kube-auth-proxy-7fbcb8d956-mmjvl\" (UID: \"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82\") " pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:58.551224 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.551182    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:58.632069 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.632036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-tls-certs\") pod \"kube-auth-proxy-7fbcb8d956-mmjvl\" (UID: \"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82\") " pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:58.634531 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.634501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82-tls-certs\") pod \"kube-auth-proxy-7fbcb8d956-mmjvl\" (UID: \"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82\") " pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:58.799907 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:58.799866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"
Sep 09 23:56:59.075574 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.075550    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl"]
Sep 09 23:56:59.078014 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:56:59.077990    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a651e7d_16f7_4aed_b5f1_7d9e21f7ac82.slice/crio-e7ecc239741276390e09a016bb0c3067ba21c652abf4317b54f90aaf7d18e6f7 WatchSource:0}: Error finding container e7ecc239741276390e09a016bb0c3067ba21c652abf4317b54f90aaf7d18e6f7: Status 404 returned error can't find the container with id e7ecc239741276390e09a016bb0c3067ba21c652abf4317b54f90aaf7d18e6f7
Sep 09 23:56:59.173185 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.173134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:59.181028 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.181003    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"]
Sep 09 23:56:59.185517 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.185498    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.187920 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.187891    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 23:56:59.188066 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.187927    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 23:56:59.188066 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.188027    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m24b7\""
Sep 09 23:56:59.188176 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.188160    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 23:56:59.188219 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.188186    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 23:56:59.198859 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.198835    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"]
Sep 09 23:56:59.236369 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.236331    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:56:59.338832 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.338748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.338832 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.338788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.338832 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.338819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.339084 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.338879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.339084 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.338923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.339084 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.338999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.339084 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.339032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd2ll\" (UniqueName: \"kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-kube-api-access-xd2ll\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.440060 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.440020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.440249 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.440080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.440249 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.440131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.440249 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.440162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd2ll\" (UniqueName: \"kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-kube-api-access-xd2ll\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.440249 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.440200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.440249 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.440225    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.440495 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.440260    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.440774 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.440745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.442275 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.442252    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.443022 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.442996    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.443130 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.443093    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.443199 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.443168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.447419 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.447398    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.447912 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.447891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd2ll\" (UniqueName: \"kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-kube-api-access-xd2ll\") pod \"istiod-openshift-gateway-7b7995d5cd-bs8q9\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.495527 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.495496    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:56:59.776421 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:56:59.776387    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"]
Sep 09 23:56:59.780188 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:56:59.780153    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cdbd4da_eb5c_41d0_b597_fd53b54be11f.slice/crio-8a38de14e53af2b13fddc80d08ac1dc3705fec466f520fe7b1775b987de50be7 WatchSource:0}: Error finding container 8a38de14e53af2b13fddc80d08ac1dc3705fec466f520fe7b1775b987de50be7: Status 404 returned error can't find the container with id 8a38de14e53af2b13fddc80d08ac1dc3705fec466f520fe7b1775b987de50be7
Sep 09 23:57:00.035924 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:00.035824    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:00.077191 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:00.077141    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9" event={"ID":"5cdbd4da-eb5c-41d0-b597-fd53b54be11f","Type":"ContainerStarted","Data":"8a38de14e53af2b13fddc80d08ac1dc3705fec466f520fe7b1775b987de50be7"}
Sep 09 23:57:00.078713 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:00.078649    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl" event={"ID":"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82","Type":"ContainerStarted","Data":"e7ecc239741276390e09a016bb0c3067ba21c652abf4317b54f90aaf7d18e6f7"}
Sep 09 23:57:02.090457 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:02.090411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl" event={"ID":"2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82","Type":"ContainerStarted","Data":"c8ec310484a5c6519c73173512ec833c2548c0640fa2906c49f36b369beba162"}
Sep 09 23:57:02.107570 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:02.107518    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl" podStartSLOduration=2.326089928 podStartE2EDuration="5.107502851s" totalImagesPullingTime="2.781412923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:57:02.105696872 +0000 UTC m=+496.237824100" watchObservedRunningTime="2026-09-09 23:57:02.107502851 +0000 UTC m=+496.239630079"
Sep 09 23:57:08.754664 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:08.754626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:08.806318 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:08.806285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:08.870779 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:08.870747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:08.920141 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:08.920098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:09.270776 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:09.270737    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:09.565516 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:09.565482    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:13.550765 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:13.550729    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:57:13.551060 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:13.550794    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:57:14.148511 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.148470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9" event={"ID":"5cdbd4da-eb5c-41d0-b597-fd53b54be11f","Type":"ContainerStarted","Data":"17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c"}
Sep 09 23:57:14.148724 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.148679    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:57:14.150454 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.150426    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-bs8q9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 23:57:14.150568 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.150477    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9" podUID="5cdbd4da-eb5c-41d0-b597-fd53b54be11f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 23:57:14.169257 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.169203    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9" podStartSLOduration=1.402420261 podStartE2EDuration="15.169183962s" totalImagesPullingTime="13.766763701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:57:14.169082028 +0000 UTC m=+508.301209263" watchObservedRunningTime="2026-09-09 23:57:14.169183962 +0000 UTC m=+508.301311191"
Sep 09 23:57:14.365197 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.365153    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:14.460684 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.460607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:14.511115 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.511078    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"]
Sep 09 23:57:14.514737 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.514704    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.517231 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.517211    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6dmb5\""
Sep 09 23:57:14.525785 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.525761    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"]
Sep 09 23:57:14.545182 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.545147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:14.575704 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.575674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.576102 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.575707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.576102 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.575734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.576102 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.575787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.576102 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.575807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3c70278-9432-41ac-955f-70dd57b13921-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.576102 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.575855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3c70278-9432-41ac-955f-70dd57b13921-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.576102 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.575889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.576102 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.575907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.576102 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.575921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pmns\" (UniqueName: \"kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-kube-api-access-6pmns\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.676881 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.676839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.676881 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.676879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677142 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.676898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677142 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.676953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677142 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.676981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3c70278-9432-41ac-955f-70dd57b13921-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677142 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.677017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3c70278-9432-41ac-955f-70dd57b13921-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677142 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.677068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677142 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.677092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677142 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.677115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pmns\" (UniqueName: \"kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-kube-api-access-6pmns\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677491 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.677347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677491 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.677420    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677583 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.677502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677789 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.677765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.677857 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.677799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3c70278-9432-41ac-955f-70dd57b13921-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.679311 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.679291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.679552 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.679533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3c70278-9432-41ac-955f-70dd57b13921-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.684326 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.684305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pmns\" (UniqueName: \"kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-kube-api-access-6pmns\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.684455 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.684437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.825800 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.825763    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:14.836960 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.836914    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"]
Sep 09 23:57:14.840918 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.840894    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.853574 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.853532    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"]
Sep 09 23:57:14.854431 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.854405    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:14.878807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.878326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.878807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.878378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.878807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.878410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.878807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.878435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmt7h\" (UniqueName: \"kubernetes.io/projected/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-kube-api-access-qmt7h\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.878807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.878510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.878807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.878547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.878807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.878571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.878807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.878653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.878807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.878679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.979816 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.979776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.979816 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.979818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980124 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.979843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980124 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.979890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980124 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.979916    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980124 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.979974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980124 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.979995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980124 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.980018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980124 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.980055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmt7h\" (UniqueName: \"kubernetes.io/projected/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-kube-api-access-qmt7h\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980532 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.980503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980595 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.980568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980656 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.980634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980715 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.980679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.980770 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.980758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.982296 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.982273    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.982487 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.982472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.988499 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.988477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:14.989031 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:14.989010    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmt7h\" (UniqueName: \"kubernetes.io/projected/6e313ddd-5fae-460b-bb4a-79aeb3a86a53-kube-api-access-qmt7h\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czjkjt\" (UID: \"6e313ddd-5fae-460b-bb4a-79aeb3a86a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:15.048850 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:15.048813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:15.104769 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:15.104680    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"]
Sep 09 23:57:15.107643 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:57:15.107615    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c70278_9432_41ac_955f_70dd57b13921.slice/crio-15d21d00fbb467a267e274478368a270a5c231502111b3bc36cc5f3bca6cd9a4 WatchSource:0}: Error finding container 15d21d00fbb467a267e274478368a270a5c231502111b3bc36cc5f3bca6cd9a4: Status 404 returned error can't find the container with id 15d21d00fbb467a267e274478368a270a5c231502111b3bc36cc5f3bca6cd9a4
Sep 09 23:57:15.154292 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:15.154255    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw" event={"ID":"d3c70278-9432-41ac-955f-70dd57b13921","Type":"ContainerStarted","Data":"15d21d00fbb467a267e274478368a270a5c231502111b3bc36cc5f3bca6cd9a4"}
Sep 09 23:57:15.155062 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:15.155043    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:57:15.160616 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:15.160596    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:15.441068 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:15.440984    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"]
Sep 09 23:57:15.444263 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:57:15.444234    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e313ddd_5fae_460b_bb4a_79aeb3a86a53.slice/crio-30d1ea2d140362bbfe5142c3a17ba5ad125dcae647a3f9be53c2e919f22dc3a4 WatchSource:0}: Error finding container 30d1ea2d140362bbfe5142c3a17ba5ad125dcae647a3f9be53c2e919f22dc3a4: Status 404 returned error can't find the container with id 30d1ea2d140362bbfe5142c3a17ba5ad125dcae647a3f9be53c2e919f22dc3a4
Sep 09 23:57:16.162692 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:16.162648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt" event={"ID":"6e313ddd-5fae-460b-bb4a-79aeb3a86a53","Type":"ContainerStarted","Data":"30d1ea2d140362bbfe5142c3a17ba5ad125dcae647a3f9be53c2e919f22dc3a4"}
Sep 09 23:57:17.094955 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.094895    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"]
Sep 09 23:57:17.098621 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.098598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.118596 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.118560    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"]
Sep 09 23:57:17.202655 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.202619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.202655 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.202655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.203183 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.202678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.203183 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.202771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.203183 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.202908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac53f64c-3f85-49fb-b9f3-13d210291fbf-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.203183 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.202987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqd2l\" (UniqueName: \"kubernetes.io/projected/ac53f64c-3f85-49fb-b9f3-13d210291fbf-kube-api-access-zqd2l\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.203183 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.203020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac53f64c-3f85-49fb-b9f3-13d210291fbf-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.303753 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.303709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac53f64c-3f85-49fb-b9f3-13d210291fbf-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.303975 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.303771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqd2l\" (UniqueName: \"kubernetes.io/projected/ac53f64c-3f85-49fb-b9f3-13d210291fbf-kube-api-access-zqd2l\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.303975 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.303799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac53f64c-3f85-49fb-b9f3-13d210291fbf-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.303975 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.303839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.303975 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.303863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.303975 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.303889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.304336 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.303983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.305099 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.305060    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.306631 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.306598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac53f64c-3f85-49fb-b9f3-13d210291fbf-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.306791 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.306755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac53f64c-3f85-49fb-b9f3-13d210291fbf-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.306897 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.306850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.306964 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.306909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.313178 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.313150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac53f64c-3f85-49fb-b9f3-13d210291fbf-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.313401 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.313379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqd2l\" (UniqueName: \"kubernetes.io/projected/ac53f64c-3f85-49fb-b9f3-13d210291fbf-kube-api-access-zqd2l\") pod \"istiod-openshift-gateway-5677ccb49b-rsfpf\" (UID: \"ac53f64c-3f85-49fb-b9f3-13d210291fbf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:17.409617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:17.409524    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:18.025807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.025760    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:57:18.025950 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.025839    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:57:18.025950 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.025880    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:57:18.032091 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.032063    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:57:18.032182 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.032148    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:57:18.032271 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.032184    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:57:18.176171 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.176119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw" event={"ID":"d3c70278-9432-41ac-955f-70dd57b13921","Type":"ContainerStarted","Data":"48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d"}
Sep 09 23:57:18.178592 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.178560    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt" event={"ID":"6e313ddd-5fae-460b-bb4a-79aeb3a86a53","Type":"ContainerStarted","Data":"57f8244f49a69d939c9897af791af40a25ca53113dac70b0b0184482b65b9d8f"}
Sep 09 23:57:18.214644 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.214552    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"]
Sep 09 23:57:18.217968 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:57:18.217923    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac53f64c_3f85_49fb_b9f3_13d210291fbf.slice/crio-3b4d7b2f06a1fd130a846751c907bdf41d109eb69719870f07a1e98f471ef848 WatchSource:0}: Error finding container 3b4d7b2f06a1fd130a846751c907bdf41d109eb69719870f07a1e98f471ef848: Status 404 returned error can't find the container with id 3b4d7b2f06a1fd130a846751c907bdf41d109eb69719870f07a1e98f471ef848
Sep 09 23:57:18.220834 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.220774    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:57:18.220961 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.220843    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:57:18.243109 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.242739    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw" podStartSLOduration=1.320639812 podStartE2EDuration="4.242716854s" totalImagesPullingTime="2.922077042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:57:18.212139409 +0000 UTC m=+512.344266619" watchObservedRunningTime="2026-09-09 23:57:18.242716854 +0000 UTC m=+512.374844084"
Sep 09 23:57:18.243628 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.243400    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt" podStartSLOduration=1.664111035 podStartE2EDuration="4.243386632s" totalImagesPullingTime="2.579275597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:57:18.240913379 +0000 UTC m=+512.373040608" watchObservedRunningTime="2026-09-09 23:57:18.243386632 +0000 UTC m=+512.375513862"
Sep 09 23:57:18.745362 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.745304    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:18.826890 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.826861    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:18.942518 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:18.942473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:19.059715 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.059681    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:19.160876 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.160845    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:19.165816 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.165789    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:19.184700 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.184661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf" event={"ID":"ac53f64c-3f85-49fb-b9f3-13d210291fbf","Type":"ContainerStarted","Data":"ffb507608fca01fff8f358669a4fe8638d8baf134ad30502732554d396e9771b"}
Sep 09 23:57:19.184857 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.184719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf" event={"ID":"ac53f64c-3f85-49fb-b9f3-13d210291fbf","Type":"ContainerStarted","Data":"3b4d7b2f06a1fd130a846751c907bdf41d109eb69719870f07a1e98f471ef848"}
Sep 09 23:57:19.185055 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.185027    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:19.185860 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.185843    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt"
Sep 09 23:57:19.211457 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.211400    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf" podStartSLOduration=2.211386823 podStartE2EDuration="2.211386823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:57:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:57:19.210490597 +0000 UTC m=+513.342617863" watchObservedRunningTime="2026-09-09 23:57:19.211386823 +0000 UTC m=+513.343514047"
Sep 09 23:57:19.264909 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.264879    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"]
Sep 09 23:57:19.560008 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.559979    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:19.827522 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.827433    2560 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Sep 09 23:57:19.827522 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:19.827492    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw" podUID="d3c70278-9432-41ac-955f-70dd57b13921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Sep 09 23:57:20.115308 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.115224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:20.189614 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.189583    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:20.191463 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.191442    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf"
Sep 09 23:57:20.214953 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.214901    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:20.249066 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.249030    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"]
Sep 09 23:57:20.249271 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.249246    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9" podUID="5cdbd4da-eb5c-41d0-b597-fd53b54be11f" containerName="discovery" containerID="cri-o://17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c" gracePeriod=30
Sep 09 23:57:20.313374 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.313346    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:20.501442 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.501417    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:57:20.535215 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.535185    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-cacerts\") pod \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") "
Sep 09 23:57:20.535376 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.535248    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-token\") pod \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") "
Sep 09 23:57:20.535376 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.535272    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd2ll\" (UniqueName: \"kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-kube-api-access-xd2ll\") pod \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") "
Sep 09 23:57:20.535376 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.535346    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-ca-configmap\") pod \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") "
Sep 09 23:57:20.535538 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.535417    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-kubeconfig\") pod \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") "
Sep 09 23:57:20.535538 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.535443    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-dns-cert\") pod \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") "
Sep 09 23:57:20.535538 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.535474    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-local-certs\") pod \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\" (UID: \"5cdbd4da-eb5c-41d0-b597-fd53b54be11f\") "
Sep 09 23:57:20.535863 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.535832    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5cdbd4da-eb5c-41d0-b597-fd53b54be11f" (UID: "5cdbd4da-eb5c-41d0-b597-fd53b54be11f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:57:20.538617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.538585    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-token" (OuterVolumeSpecName: "istio-token") pod "5cdbd4da-eb5c-41d0-b597-fd53b54be11f" (UID: "5cdbd4da-eb5c-41d0-b597-fd53b54be11f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:57:20.538617 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.538664    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-cacerts" (OuterVolumeSpecName: "cacerts") pod "5cdbd4da-eb5c-41d0-b597-fd53b54be11f" (UID: "5cdbd4da-eb5c-41d0-b597-fd53b54be11f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:57:20.539022 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.538856    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-local-certs" (OuterVolumeSpecName: "local-certs") pod "5cdbd4da-eb5c-41d0-b597-fd53b54be11f" (UID: "5cdbd4da-eb5c-41d0-b597-fd53b54be11f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:57:20.539022 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.538990    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-kube-api-access-xd2ll" (OuterVolumeSpecName: "kube-api-access-xd2ll") pod "5cdbd4da-eb5c-41d0-b597-fd53b54be11f" (UID: "5cdbd4da-eb5c-41d0-b597-fd53b54be11f"). InnerVolumeSpecName "kube-api-access-xd2ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:57:20.539141 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.539072    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5cdbd4da-eb5c-41d0-b597-fd53b54be11f" (UID: "5cdbd4da-eb5c-41d0-b597-fd53b54be11f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:57:20.539453 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.539429    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5cdbd4da-eb5c-41d0-b597-fd53b54be11f" (UID: "5cdbd4da-eb5c-41d0-b597-fd53b54be11f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:57:20.637056 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.637018    2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-kubeconfig\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:20.637056 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.637048    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-dns-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:20.637056 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.637059    2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-local-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:20.637282 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.637067    2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-cacerts\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:20.637282 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.637076    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:20.637282 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.637084    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd2ll\" (UniqueName: \"kubernetes.io/projected/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-kube-api-access-xd2ll\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:20.637282 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.637093    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cdbd4da-eb5c-41d0-b597-fd53b54be11f-istio-csr-ca-configmap\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:20.826766 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.826729    2560 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Sep 09 23:57:20.826962 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:20.826786    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw" podUID="d3c70278-9432-41ac-955f-70dd57b13921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Sep 09 23:57:21.201188 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:21.201101    2560 generic.go:356] "Generic (PLEG): container finished" podID="5cdbd4da-eb5c-41d0-b597-fd53b54be11f" containerID="17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c" exitCode=0
Sep 09 23:57:21.201188 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:21.201152    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"
Sep 09 23:57:21.201360 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:21.201203    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9" event={"ID":"5cdbd4da-eb5c-41d0-b597-fd53b54be11f","Type":"ContainerDied","Data":"17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c"}
Sep 09 23:57:21.201360 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:21.201264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9" event={"ID":"5cdbd4da-eb5c-41d0-b597-fd53b54be11f","Type":"ContainerDied","Data":"8a38de14e53af2b13fddc80d08ac1dc3705fec466f520fe7b1775b987de50be7"}
Sep 09 23:57:21.201360 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:21.201288    2560 scope.go:117] "RemoveContainer" containerID="17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c"
Sep 09 23:57:21.201504 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:21.201443    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw" podUID="d3c70278-9432-41ac-955f-70dd57b13921" containerName="istio-proxy" containerID="cri-o://48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d" gracePeriod=30
Sep 09 23:57:21.211010 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:21.210991    2560 scope.go:117] "RemoveContainer" containerID="17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c"
Sep 09 23:57:21.211304 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:57:21.211279    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c\": container with ID starting with 17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c not found: ID does not exist" containerID="17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c"
Sep 09 23:57:21.211405 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:21.211309    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c"} err="failed to get container status \"17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c\": rpc error: code = NotFound desc = could not find container \"17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c\": container with ID starting with 17680e023cdd7a05a63d535ac637f0927ecf4d32ab105df06421ae1249e5136c not found: ID does not exist"
Sep 09 23:57:21.239964 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:21.239923    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"]
Sep 09 23:57:21.244437 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:21.244412    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9"]
Sep 09 23:57:22.339229 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:22.339189    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cdbd4da-eb5c-41d0-b597-fd53b54be11f" path="/var/lib/kubelet/pods/5cdbd4da-eb5c-41d0-b597-fd53b54be11f/volumes"
Sep 09 23:57:26.457276 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.457249    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:26.585032 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.584991    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pmns\" (UniqueName: \"kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-kube-api-access-6pmns\") pod \"d3c70278-9432-41ac-955f-70dd57b13921\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") "
Sep 09 23:57:26.585195 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585056    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-certs\") pod \"d3c70278-9432-41ac-955f-70dd57b13921\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") "
Sep 09 23:57:26.585195 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585124    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3c70278-9432-41ac-955f-70dd57b13921-istio-podinfo\") pod \"d3c70278-9432-41ac-955f-70dd57b13921\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") "
Sep 09 23:57:26.585195 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585153    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-credential-socket\") pod \"d3c70278-9432-41ac-955f-70dd57b13921\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") "
Sep 09 23:57:26.585195 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585184    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-data\") pod \"d3c70278-9432-41ac-955f-70dd57b13921\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") "
Sep 09 23:57:26.585417 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-socket\") pod \"d3c70278-9432-41ac-955f-70dd57b13921\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") "
Sep 09 23:57:26.585417 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585264    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-istio-token\") pod \"d3c70278-9432-41ac-955f-70dd57b13921\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") "
Sep 09 23:57:26.585417 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585294    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-envoy\") pod \"d3c70278-9432-41ac-955f-70dd57b13921\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") "
Sep 09 23:57:26.585417 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585357    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3c70278-9432-41ac-955f-70dd57b13921-istiod-ca-cert\") pod \"d3c70278-9432-41ac-955f-70dd57b13921\" (UID: \"d3c70278-9432-41ac-955f-70dd57b13921\") "
Sep 09 23:57:26.585625 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585430    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3c70278-9432-41ac-955f-70dd57b13921" (UID: "d3c70278-9432-41ac-955f-70dd57b13921"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:57:26.585625 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585517    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3c70278-9432-41ac-955f-70dd57b13921" (UID: "d3c70278-9432-41ac-955f-70dd57b13921"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:57:26.585817 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585765    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3c70278-9432-41ac-955f-70dd57b13921" (UID: "d3c70278-9432-41ac-955f-70dd57b13921"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:57:26.585817 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585783    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3c70278-9432-41ac-955f-70dd57b13921" (UID: "d3c70278-9432-41ac-955f-70dd57b13921"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:57:26.585958 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.585827    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3c70278-9432-41ac-955f-70dd57b13921-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3c70278-9432-41ac-955f-70dd57b13921" (UID: "d3c70278-9432-41ac-955f-70dd57b13921"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:57:26.586261 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.586236    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3c70278-9432-41ac-955f-70dd57b13921-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:26.586381 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.586266    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:26.586381 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.586281    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:26.586381 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.586295    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:26.586381 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.586308    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:26.587422 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.587399    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3c70278-9432-41ac-955f-70dd57b13921-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3c70278-9432-41ac-955f-70dd57b13921" (UID: "d3c70278-9432-41ac-955f-70dd57b13921"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 23:57:26.587858 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.587832    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-kube-api-access-6pmns" (OuterVolumeSpecName: "kube-api-access-6pmns") pod "d3c70278-9432-41ac-955f-70dd57b13921" (UID: "d3c70278-9432-41ac-955f-70dd57b13921"). InnerVolumeSpecName "kube-api-access-6pmns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:57:26.587858 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.587836    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3c70278-9432-41ac-955f-70dd57b13921" (UID: "d3c70278-9432-41ac-955f-70dd57b13921"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:57:26.588008 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.587913    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3c70278-9432-41ac-955f-70dd57b13921" (UID: "d3c70278-9432-41ac-955f-70dd57b13921"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:57:26.687000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.686964    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:26.687000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.686994    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3c70278-9432-41ac-955f-70dd57b13921-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:26.687000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.687005    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pmns\" (UniqueName: \"kubernetes.io/projected/d3c70278-9432-41ac-955f-70dd57b13921-kube-api-access-6pmns\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:26.687219 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:26.687015    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3c70278-9432-41ac-955f-70dd57b13921-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:57:27.230130 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:27.230093    2560 generic.go:356] "Generic (PLEG): container finished" podID="d3c70278-9432-41ac-955f-70dd57b13921" containerID="48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d" exitCode=0
Sep 09 23:57:27.230337 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:27.230145    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"
Sep 09 23:57:27.230337 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:27.230184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw" event={"ID":"d3c70278-9432-41ac-955f-70dd57b13921","Type":"ContainerDied","Data":"48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d"}
Sep 09 23:57:27.230337 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:27.230253    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw" event={"ID":"d3c70278-9432-41ac-955f-70dd57b13921","Type":"ContainerDied","Data":"15d21d00fbb467a267e274478368a270a5c231502111b3bc36cc5f3bca6cd9a4"}
Sep 09 23:57:27.230337 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:27.230283    2560 scope.go:117] "RemoveContainer" containerID="48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d"
Sep 09 23:57:27.239647 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:27.239628    2560 scope.go:117] "RemoveContainer" containerID="48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d"
Sep 09 23:57:27.239954 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:57:27.239914    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d\": container with ID starting with 48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d not found: ID does not exist" containerID="48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d"
Sep 09 23:57:27.240030 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:27.239957    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d"} err="failed to get container status \"48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d\": rpc error: code = NotFound desc = could not find container \"48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d\": container with ID starting with 48a444bb9a216dfca466dfa2cb2c437660523455290c2c9ae18287e7cb44809d not found: ID does not exist"
Sep 09 23:57:27.251362 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:27.251331    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"]
Sep 09 23:57:27.255370 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:27.255347    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw"]
Sep 09 23:57:28.339297 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:28.339261    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3c70278-9432-41ac-955f-70dd57b13921" path="/var/lib/kubelet/pods/d3c70278-9432-41ac-955f-70dd57b13921/volumes"
Sep 09 23:57:30.578488 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:30.578444    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:32.533819 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:32.533786    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:57:32.635228 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:57:32.635195    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:01.009945 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:01.009899    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:09.647142 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:09.647105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:09.716194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:09.716159    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:46.276364 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:46.276260    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 09 23:58:46.280313 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:46.277280    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 09 23:58:50.478054 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.478014    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b4868bfb-mmgtr"]
Sep 09 23:58:50.479022 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.478994    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c70278-9432-41ac-955f-70dd57b13921" containerName="istio-proxy"
Sep 09 23:58:50.479176 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.479165    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c70278-9432-41ac-955f-70dd57b13921" containerName="istio-proxy"
Sep 09 23:58:50.479279 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.479269    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdbd4da-eb5c-41d0-b597-fd53b54be11f" containerName="discovery"
Sep 09 23:58:50.479353 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.479345    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdbd4da-eb5c-41d0-b597-fd53b54be11f" containerName="discovery"
Sep 09 23:58:50.479522 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.479511    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cdbd4da-eb5c-41d0-b597-fd53b54be11f" containerName="discovery"
Sep 09 23:58:50.479609 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.479599    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c70278-9432-41ac-955f-70dd57b13921" containerName="istio-proxy"
Sep 09 23:58:50.482882 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.482858    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.492797 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.492774    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4868bfb-mmgtr"]
Sep 09 23:58:50.537972 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.537927    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:50.601580 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.601549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-service-ca\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.601753 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.601606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-trusted-ca-bundle\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.601753 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.601629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-oauth-serving-cert\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.601753 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.601664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac22dbde-9e34-4712-8e1e-e8f58c622d15-console-oauth-config\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.601753 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.601680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb9kw\" (UniqueName: \"kubernetes.io/projected/ac22dbde-9e34-4712-8e1e-e8f58c622d15-kube-api-access-sb9kw\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.601960 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.601772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-console-config\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.601960 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.601822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac22dbde-9e34-4712-8e1e-e8f58c622d15-console-serving-cert\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.639599 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.639569    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:50.702903 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.702853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-console-config\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.702903 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.702907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac22dbde-9e34-4712-8e1e-e8f58c622d15-console-serving-cert\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.703153 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.702982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-service-ca\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.703153 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.703077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-trusted-ca-bundle\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.703153 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.703114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-oauth-serving-cert\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.703312 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.703155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac22dbde-9e34-4712-8e1e-e8f58c622d15-console-oauth-config\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.703312 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.703181    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb9kw\" (UniqueName: \"kubernetes.io/projected/ac22dbde-9e34-4712-8e1e-e8f58c622d15-kube-api-access-sb9kw\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.703763 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.703731    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-console-config\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.703877 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.703777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-service-ca\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.703877 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.703843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-oauth-serving-cert\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.704151 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.704116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac22dbde-9e34-4712-8e1e-e8f58c622d15-trusted-ca-bundle\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.705591 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.705568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac22dbde-9e34-4712-8e1e-e8f58c622d15-console-oauth-config\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.705643 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.705578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac22dbde-9e34-4712-8e1e-e8f58c622d15-console-serving-cert\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.712637 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.712612    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb9kw\" (UniqueName: \"kubernetes.io/projected/ac22dbde-9e34-4712-8e1e-e8f58c622d15-kube-api-access-sb9kw\") pod \"console-b4868bfb-mmgtr\" (UID: \"ac22dbde-9e34-4712-8e1e-e8f58c622d15\") " pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:50.741396 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.741312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:50.792895 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:50.792855    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:58:51.065417 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:51.065389    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4868bfb-mmgtr"]
Sep 09 23:58:51.067849 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:58:51.067820    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac22dbde_9e34_4712_8e1e_e8f58c622d15.slice/crio-0245fd0d82dd1759f4462f10810b1cc3501e936e18e8858d6d1ebb04ab6b6a50 WatchSource:0}: Error finding container 0245fd0d82dd1759f4462f10810b1cc3501e936e18e8858d6d1ebb04ab6b6a50: Status 404 returned error can't find the container with id 0245fd0d82dd1759f4462f10810b1cc3501e936e18e8858d6d1ebb04ab6b6a50
Sep 09 23:58:51.277063 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:51.277024    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:51.346520 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:51.346440    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:51.605788 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:51.605709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4868bfb-mmgtr" event={"ID":"ac22dbde-9e34-4712-8e1e-e8f58c622d15","Type":"ContainerStarted","Data":"afe0193ee442f64462c4d4f45289809a4c9f6e9fddaf11b7b5c7758bbdf845d4"}
Sep 09 23:58:51.605788 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:51.605756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4868bfb-mmgtr" event={"ID":"ac22dbde-9e34-4712-8e1e-e8f58c622d15","Type":"ContainerStarted","Data":"0245fd0d82dd1759f4462f10810b1cc3501e936e18e8858d6d1ebb04ab6b6a50"}
Sep 09 23:58:51.627762 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:51.627716    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b4868bfb-mmgtr" podStartSLOduration=1.627699679 podStartE2EDuration="1.627699679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:58:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:58:51.626222711 +0000 UTC m=+605.758349937" watchObservedRunningTime="2026-09-09 23:58:51.627699679 +0000 UTC m=+605.759826907"
Sep 09 23:58:53.214921 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:53.214888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:55.254347 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.254310    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"]
Sep 09 23:58:55.257925 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.257899    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:58:55.264336 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.264311    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 23:58:55.265468 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.265435    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bd7td\""
Sep 09 23:58:55.265553 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.265475    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 23:58:55.272888 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.272853    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"]
Sep 09 23:58:55.345377 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.345345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5f2n\" (UniqueName: \"kubernetes.io/projected/029a6c08-10ea-4a6b-a4be-297a62c10d11-kube-api-access-q5f2n\") pod \"limitador-operator-controller-manager-74495c69f8-vnfp2\" (UID: \"029a6c08-10ea-4a6b-a4be-297a62c10d11\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:58:55.446471 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.446438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5f2n\" (UniqueName: \"kubernetes.io/projected/029a6c08-10ea-4a6b-a4be-297a62c10d11-kube-api-access-q5f2n\") pod \"limitador-operator-controller-manager-74495c69f8-vnfp2\" (UID: \"029a6c08-10ea-4a6b-a4be-297a62c10d11\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:58:55.454175 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.454148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5f2n\" (UniqueName: \"kubernetes.io/projected/029a6c08-10ea-4a6b-a4be-297a62c10d11-kube-api-access-q5f2n\") pod \"limitador-operator-controller-manager-74495c69f8-vnfp2\" (UID: \"029a6c08-10ea-4a6b-a4be-297a62c10d11\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:58:55.567677 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.567649    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:58:55.617446 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.617418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:55.843260 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:55.843215    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"]
Sep 09 23:58:55.844308 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:58:55.844267    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod029a6c08_10ea_4a6b_a4be_297a62c10d11.slice/crio-18214298234afbfa01264eb427900529ea58f55b443b7ab0bdb0ec7e5448a46c WatchSource:0}: Error finding container 18214298234afbfa01264eb427900529ea58f55b443b7ab0bdb0ec7e5448a46c: Status 404 returned error can't find the container with id 18214298234afbfa01264eb427900529ea58f55b443b7ab0bdb0ec7e5448a46c
Sep 09 23:58:56.010782 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:56.010745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:56.635285 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:56.635244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2" event={"ID":"029a6c08-10ea-4a6b-a4be-297a62c10d11","Type":"ContainerStarted","Data":"18214298234afbfa01264eb427900529ea58f55b443b7ab0bdb0ec7e5448a46c"}
Sep 09 23:58:57.866742 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:57.866710    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:58.647270 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:58.647235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2" event={"ID":"029a6c08-10ea-4a6b-a4be-297a62c10d11","Type":"ContainerStarted","Data":"18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d"}
Sep 09 23:58:58.647440 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:58.647311    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:58:58.662565 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:58.662534    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:58:58.669147 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:58.669101    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2" podStartSLOduration=1.287800461 podStartE2EDuration="3.669086556s" totalImagesPullingTime="2.381286095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:58:58.667828529 +0000 UTC m=+612.799955759" watchObservedRunningTime="2026-09-09 23:58:58.669086556 +0000 UTC m=+612.801213830"
Sep 09 23:58:59.247868 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:58:59.247834    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:00.203901 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.203867    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv"]
Sep 09 23:59:00.207226 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.207211    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv"
Sep 09 23:59:00.209875 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.209848    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 09 23:59:00.210010 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.209923    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5h2sg\""
Sep 09 23:59:00.218871 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.218845    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv"]
Sep 09 23:59:00.291883 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.291828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkxq8\" (UniqueName: \"kubernetes.io/projected/b08319e6-e048-4c0f-a333-ea3a659a17c0-kube-api-access-xkxq8\") pod \"dns-operator-controller-manager-7b84cd7c9c-wvmtv\" (UID: \"b08319e6-e048-4c0f-a333-ea3a659a17c0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv"
Sep 09 23:59:00.393118 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.393081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkxq8\" (UniqueName: \"kubernetes.io/projected/b08319e6-e048-4c0f-a333-ea3a659a17c0-kube-api-access-xkxq8\") pod \"dns-operator-controller-manager-7b84cd7c9c-wvmtv\" (UID: \"b08319e6-e048-4c0f-a333-ea3a659a17c0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv"
Sep 09 23:59:00.406776 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.406743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkxq8\" (UniqueName: \"kubernetes.io/projected/b08319e6-e048-4c0f-a333-ea3a659a17c0-kube-api-access-xkxq8\") pod \"dns-operator-controller-manager-7b84cd7c9c-wvmtv\" (UID: \"b08319e6-e048-4c0f-a333-ea3a659a17c0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv"
Sep 09 23:59:00.519356 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.519288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv"
Sep 09 23:59:00.555742 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.555712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:00.656657 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.656626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:00.791485 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.791462    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv"]
Sep 09 23:59:00.792951 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.792916    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:59:00.793085 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.792991    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:59:00.793309 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:59:00.793280    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08319e6_e048_4c0f_a333_ea3a659a17c0.slice/crio-322c55d55c090179ddef0aa4d8a9724e93421f62e6eccddd26ffdce3d806d04a WatchSource:0}: Error finding container 322c55d55c090179ddef0aa4d8a9724e93421f62e6eccddd26ffdce3d806d04a: Status 404 returned error can't find the container with id 322c55d55c090179ddef0aa4d8a9724e93421f62e6eccddd26ffdce3d806d04a
Sep 09 23:59:00.795884 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.795867    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:59:00.798579 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:00.798558    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:59:01.207563 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:01.207535    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:01.458188 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:01.458102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:01.611392 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:01.611358    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:01.662416 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:01.662387    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv" event={"ID":"b08319e6-e048-4c0f-a333-ea3a659a17c0","Type":"ContainerStarted","Data":"322c55d55c090179ddef0aa4d8a9724e93421f62e6eccddd26ffdce3d806d04a"}
Sep 09 23:59:01.666103 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:01.666085    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b4868bfb-mmgtr"
Sep 09 23:59:01.693372 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:01.693341    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:01.736191 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:01.736091    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff5d7bb9c-x5klv"]
Sep 09 23:59:01.974037 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:01.973780    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:02.105253 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:02.105214    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:03.678551 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:03.678514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv" event={"ID":"b08319e6-e048-4c0f-a333-ea3a659a17c0","Type":"ContainerStarted","Data":"c88f747390cd2163c3445aafac97f38317678808b347fc6116ee558d877e8880"}
Sep 09 23:59:03.679006 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:03.678644    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv"
Sep 09 23:59:03.696298 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:03.696255    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv" podStartSLOduration=1.802531804 podStartE2EDuration="3.696242653s" totalImagesPullingTime="1.893710849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:59:03.694905607 +0000 UTC m=+617.827032836" watchObservedRunningTime="2026-09-09 23:59:03.696242653 +0000 UTC m=+617.828369880"
Sep 09 23:59:04.341750 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.341717    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"]
Sep 09 23:59:04.345059 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.345042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:04.347470 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.347451    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ql4b9\""
Sep 09 23:59:04.358262 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.358239    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"]
Sep 09 23:59:04.429675 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.429646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25155b32-6cf0-4668-8e3b-6fb1a48abc72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" (UID: \"25155b32-6cf0-4668-8e3b-6fb1a48abc72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:04.429804 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.429682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc5r5\" (UniqueName: \"kubernetes.io/projected/25155b32-6cf0-4668-8e3b-6fb1a48abc72-kube-api-access-tc5r5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" (UID: \"25155b32-6cf0-4668-8e3b-6fb1a48abc72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:04.530894 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.530854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25155b32-6cf0-4668-8e3b-6fb1a48abc72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" (UID: \"25155b32-6cf0-4668-8e3b-6fb1a48abc72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:04.530894 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.530901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc5r5\" (UniqueName: \"kubernetes.io/projected/25155b32-6cf0-4668-8e3b-6fb1a48abc72-kube-api-access-tc5r5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" (UID: \"25155b32-6cf0-4668-8e3b-6fb1a48abc72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:04.531318 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.531296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25155b32-6cf0-4668-8e3b-6fb1a48abc72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" (UID: \"25155b32-6cf0-4668-8e3b-6fb1a48abc72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:04.538592 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.538568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc5r5\" (UniqueName: \"kubernetes.io/projected/25155b32-6cf0-4668-8e3b-6fb1a48abc72-kube-api-access-tc5r5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" (UID: \"25155b32-6cf0-4668-8e3b-6fb1a48abc72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:04.655056 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.654962    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:04.934963 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:04.934916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"]
Sep 09 23:59:04.937483 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:59:04.937455    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25155b32_6cf0_4668_8e3b_6fb1a48abc72.slice/crio-0a3bce56b9c739aebdcf33cedfc145eb5a8489cb5afb8e93e764fe2471834531 WatchSource:0}: Error finding container 0a3bce56b9c739aebdcf33cedfc145eb5a8489cb5afb8e93e764fe2471834531: Status 404 returned error can't find the container with id 0a3bce56b9c739aebdcf33cedfc145eb5a8489cb5afb8e93e764fe2471834531
Sep 09 23:59:05.688751 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:05.688714    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7" event={"ID":"25155b32-6cf0-4668-8e3b-6fb1a48abc72","Type":"ContainerStarted","Data":"0a3bce56b9c739aebdcf33cedfc145eb5a8489cb5afb8e93e764fe2471834531"}
Sep 09 23:59:06.618302 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:06.618271    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:06.718650 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:06.718616    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:07.621621 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:07.621559    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:07.690811 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:07.690773    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:09.655249 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:09.655218    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:59:09.717723 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:09.717686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7" event={"ID":"25155b32-6cf0-4668-8e3b-6fb1a48abc72","Type":"ContainerStarted","Data":"401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02"}
Sep 09 23:59:09.717870 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:09.717808    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:09.736323 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:09.736274    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7" podStartSLOduration=1.983543493 podStartE2EDuration="5.736257911s" totalImagesPullingTime="3.752714418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:59:09.734350244 +0000 UTC m=+623.866477472" watchObservedRunningTime="2026-09-09 23:59:09.736257911 +0000 UTC m=+623.868385139"
Sep 09 23:59:10.254003 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:10.253966    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:10.359242 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:10.359210    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:11.376965 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:11.376917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:11.675089 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:11.674998    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:12.683528 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:12.683495    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:12.748886 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:12.748808    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:14.685181 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:14.685142    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvmtv"
Sep 09 23:59:19.156608 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:19.156568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:19.258034 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:19.257991    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:19.317795 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:19.317762    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:20.725088 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:20.725055    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:21.623139 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:21.623104    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"]
Sep 09 23:59:21.628111 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:21.628087    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:21.641255 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:21.641230    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"]
Sep 09 23:59:21.791078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:21.791041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71246607-7885-472b-a12c-0311b65b7c23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" (UID: \"71246607-7885-472b-a12c-0311b65b7c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:21.791470 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:21.791089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs46d\" (UniqueName: \"kubernetes.io/projected/71246607-7885-472b-a12c-0311b65b7c23-kube-api-access-zs46d\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" (UID: \"71246607-7885-472b-a12c-0311b65b7c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:21.892207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:21.892098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71246607-7885-472b-a12c-0311b65b7c23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" (UID: \"71246607-7885-472b-a12c-0311b65b7c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:21.892207 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:21.892177    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs46d\" (UniqueName: \"kubernetes.io/projected/71246607-7885-472b-a12c-0311b65b7c23-kube-api-access-zs46d\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" (UID: \"71246607-7885-472b-a12c-0311b65b7c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:21.892551 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:21.892529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71246607-7885-472b-a12c-0311b65b7c23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" (UID: \"71246607-7885-472b-a12c-0311b65b7c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:21.900229 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:21.900199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs46d\" (UniqueName: \"kubernetes.io/projected/71246607-7885-472b-a12c-0311b65b7c23-kube-api-access-zs46d\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" (UID: \"71246607-7885-472b-a12c-0311b65b7c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:21.937845 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:21.937815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:22.213290 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.213266    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"]
Sep 09 23:59:22.215449 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:59:22.215401    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71246607_7885_472b_a12c_0311b65b7c23.slice/crio-2b6b13c4207ea2cfbcbd262814b82fad39025a44cd3b2e1ef2f1a88aaf9b5750 WatchSource:0}: Error finding container 2b6b13c4207ea2cfbcbd262814b82fad39025a44cd3b2e1ef2f1a88aaf9b5750: Status 404 returned error can't find the container with id 2b6b13c4207ea2cfbcbd262814b82fad39025a44cd3b2e1ef2f1a88aaf9b5750
Sep 09 23:59:22.727503 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.727462    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"]
Sep 09 23:59:22.733620 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.733593    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"]
Sep 09 23:59:22.746493 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.746455    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"]
Sep 09 23:59:22.746702 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.746673    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" containerName="manager" containerID="cri-o://401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02" gracePeriod=2
Sep 09 23:59:22.758663 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.758625    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"]
Sep 09 23:59:22.759214 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.759192    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71246607-7885-472b-a12c-0311b65b7c23" containerName="manager"
Sep 09 23:59:22.759361 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.759348    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="71246607-7885-472b-a12c-0311b65b7c23" containerName="manager"
Sep 09 23:59:22.759592 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.759576    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="71246607-7885-472b-a12c-0311b65b7c23" containerName="manager"
Sep 09 23:59:22.761888 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:22.761856    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"25155b32-6cf0-4668-8e3b-6fb1a48abc72\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\": pods \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:22.785361 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.785307    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"]
Sep 09 23:59:22.785361 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.785357    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"]
Sep 09 23:59:22.785594 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.785413    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:22.786048 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.785970    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" containerName="manager"
Sep 09 23:59:22.786048 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.785991    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" containerName="manager"
Sep 09 23:59:22.786289 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.786098    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" containerName="manager"
Sep 09 23:59:22.788311 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:22.787911    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:22.790536 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:22.790518    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s" container="manager"
Sep 09 23:59:22.808914 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.808878    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"]
Sep 09 23:59:22.809403 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.808957    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"]
Sep 09 23:59:22.809403 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.808992    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"]
Sep 09 23:59:22.809403 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.809017    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"]
Sep 09 23:59:22.809403 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.809044    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m"]
Sep 09 23:59:22.809403 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.809124    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:22.809403 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.809115    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" containerName="manager" containerID="cri-o://18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d" gracePeriod=2
Sep 09 23:59:22.809790 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.809762    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" containerName="manager"
Sep 09 23:59:22.809790 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.809784    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" containerName="manager"
Sep 09 23:59:22.809894 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.809877    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" containerName="manager"
Sep 09 23:59:22.820731 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:22.820458    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:22.825233 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.825204    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m"]
Sep 09 23:59:22.825400 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.825308    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m"
Sep 09 23:59:22.847864 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:22.847801    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vnfp2\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:59:22.849922 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:22.849881    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="71246607-7885-472b-a12c-0311b65b7c23" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:22.851915 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:22.851877    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:22.854141 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:22.854108    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vnfp2\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:59:22.872558 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:22.872518    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="71246607-7885-472b-a12c-0311b65b7c23" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:22.900574 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.900535    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/851a463e-069d-467c-9a0c-c414ba76d2cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-qk7xk\" (UID: \"851a463e-069d-467c-9a0c-c414ba76d2cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:22.900716 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:22.900591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2dmp\" (UniqueName: \"kubernetes.io/projected/851a463e-069d-467c-9a0c-c414ba76d2cb-kube-api-access-j2dmp\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-qk7xk\" (UID: \"851a463e-069d-467c-9a0c-c414ba76d2cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:23.001878 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.001845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x86sl\" (UniqueName: \"kubernetes.io/projected/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-kube-api-access-x86sl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-drdj5\" (UID: \"9049ab7c-0af6-4c9e-a6ef-11b3be15c850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:23.002092 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.001895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/851a463e-069d-467c-9a0c-c414ba76d2cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-qk7xk\" (UID: \"851a463e-069d-467c-9a0c-c414ba76d2cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:23.002092 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.001918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2dmp\" (UniqueName: \"kubernetes.io/projected/851a463e-069d-467c-9a0c-c414ba76d2cb-kube-api-access-j2dmp\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-qk7xk\" (UID: \"851a463e-069d-467c-9a0c-c414ba76d2cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:23.002092 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.001958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-drdj5\" (UID: \"9049ab7c-0af6-4c9e-a6ef-11b3be15c850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:23.002092 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.002004    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj5gb\" (UniqueName: \"kubernetes.io/projected/db003c1f-2811-4f0b-91c4-a9b605533bb5-kube-api-access-tj5gb\") pod \"limitador-operator-controller-manager-74495c69f8-qw85m\" (UID: \"db003c1f-2811-4f0b-91c4-a9b605533bb5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m"
Sep 09 23:59:23.002346 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.002327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/851a463e-069d-467c-9a0c-c414ba76d2cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-qk7xk\" (UID: \"851a463e-069d-467c-9a0c-c414ba76d2cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:23.020446 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.020406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2dmp\" (UniqueName: \"kubernetes.io/projected/851a463e-069d-467c-9a0c-c414ba76d2cb-kube-api-access-j2dmp\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-qk7xk\" (UID: \"851a463e-069d-467c-9a0c-c414ba76d2cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:23.095872 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.095843    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:23.098175 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.098145    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="71246607-7885-472b-a12c-0311b65b7c23" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:23.100332 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.100309    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:23.102295 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.102274    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vnfp2\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:59:23.102359 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.102343    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25155b32-6cf0-4668-8e3b-6fb1a48abc72-extensions-socket-volume\") pod \"25155b32-6cf0-4668-8e3b-6fb1a48abc72\" (UID: \"25155b32-6cf0-4668-8e3b-6fb1a48abc72\") "
Sep 09 23:59:23.102400 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.102375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc5r5\" (UniqueName: \"kubernetes.io/projected/25155b32-6cf0-4668-8e3b-6fb1a48abc72-kube-api-access-tc5r5\") pod \"25155b32-6cf0-4668-8e3b-6fb1a48abc72\" (UID: \"25155b32-6cf0-4668-8e3b-6fb1a48abc72\") "
Sep 09 23:59:23.102482 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.102467    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-drdj5\" (UID: \"9049ab7c-0af6-4c9e-a6ef-11b3be15c850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:23.102547 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.102532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj5gb\" (UniqueName: \"kubernetes.io/projected/db003c1f-2811-4f0b-91c4-a9b605533bb5-kube-api-access-tj5gb\") pod \"limitador-operator-controller-manager-74495c69f8-qw85m\" (UID: \"db003c1f-2811-4f0b-91c4-a9b605533bb5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m"
Sep 09 23:59:23.102608 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.102566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x86sl\" (UniqueName: \"kubernetes.io/projected/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-kube-api-access-x86sl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-drdj5\" (UID: \"9049ab7c-0af6-4c9e-a6ef-11b3be15c850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:23.102852 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.102821    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25155b32-6cf0-4668-8e3b-6fb1a48abc72-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "25155b32-6cf0-4668-8e3b-6fb1a48abc72" (UID: "25155b32-6cf0-4668-8e3b-6fb1a48abc72"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:59:23.102852 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.102827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-drdj5\" (UID: \"9049ab7c-0af6-4c9e-a6ef-11b3be15c850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:23.104530 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.104508    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25155b32-6cf0-4668-8e3b-6fb1a48abc72-kube-api-access-tc5r5" (OuterVolumeSpecName: "kube-api-access-tc5r5") pod "25155b32-6cf0-4668-8e3b-6fb1a48abc72" (UID: "25155b32-6cf0-4668-8e3b-6fb1a48abc72"). InnerVolumeSpecName "kube-api-access-tc5r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:59:23.109987 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.109967    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x86sl\" (UniqueName: \"kubernetes.io/projected/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-kube-api-access-x86sl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-drdj5\" (UID: \"9049ab7c-0af6-4c9e-a6ef-11b3be15c850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:23.110072 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.110006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj5gb\" (UniqueName: \"kubernetes.io/projected/db003c1f-2811-4f0b-91c4-a9b605533bb5-kube-api-access-tj5gb\") pod \"limitador-operator-controller-manager-74495c69f8-qw85m\" (UID: \"db003c1f-2811-4f0b-91c4-a9b605533bb5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m"
Sep 09 23:59:23.120264 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.120236    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:59:23.122628 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.122608    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:23.124922 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.124890    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vnfp2\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:59:23.126977 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.126951    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="71246607-7885-472b-a12c-0311b65b7c23" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:23.177639 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.177606    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:23.184711 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.184683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:23.190341 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.190322    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m"
Sep 09 23:59:23.202879 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.202860    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5f2n\" (UniqueName: \"kubernetes.io/projected/029a6c08-10ea-4a6b-a4be-297a62c10d11-kube-api-access-q5f2n\") pod \"029a6c08-10ea-4a6b-a4be-297a62c10d11\" (UID: \"029a6c08-10ea-4a6b-a4be-297a62c10d11\") "
Sep 09 23:59:23.203100 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.203086    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25155b32-6cf0-4668-8e3b-6fb1a48abc72-extensions-socket-volume\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:23.203146 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.203102    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc5r5\" (UniqueName: \"kubernetes.io/projected/25155b32-6cf0-4668-8e3b-6fb1a48abc72-kube-api-access-tc5r5\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:23.204864 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.204846    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/029a6c08-10ea-4a6b-a4be-297a62c10d11-kube-api-access-q5f2n" (OuterVolumeSpecName: "kube-api-access-q5f2n") pod "029a6c08-10ea-4a6b-a4be-297a62c10d11" (UID: "029a6c08-10ea-4a6b-a4be-297a62c10d11"). InnerVolumeSpecName "kube-api-access-q5f2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:59:23.303681 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.303653    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5f2n\" (UniqueName: \"kubernetes.io/projected/029a6c08-10ea-4a6b-a4be-297a62c10d11-kube-api-access-q5f2n\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:23.477422 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.477389    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"]
Sep 09 23:59:23.478098 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:59:23.478073    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851a463e_069d_467c_9a0c_c414ba76d2cb.slice/crio-9efd126f3a2ad53f7770d846ccf3a6396bdd195248278bd8a3097421d73556d4 WatchSource:0}: Error finding container 9efd126f3a2ad53f7770d846ccf3a6396bdd195248278bd8a3097421d73556d4: Status 404 returned error can't find the container with id 9efd126f3a2ad53f7770d846ccf3a6396bdd195248278bd8a3097421d73556d4
Sep 09 23:59:23.503960 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.503868    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"]
Sep 09 23:59:23.507206 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:59:23.507173    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9049ab7c_0af6_4c9e_a6ef_11b3be15c850.slice/crio-e68b2edf8cf21ea60631b61ba35310dd7b349aa4a80511fe569491eebc5ff16f WatchSource:0}: Error finding container e68b2edf8cf21ea60631b61ba35310dd7b349aa4a80511fe569491eebc5ff16f: Status 404 returned error can't find the container with id e68b2edf8cf21ea60631b61ba35310dd7b349aa4a80511fe569491eebc5ff16f
Sep 09 23:59:23.527754 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.527672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m"]
Sep 09 23:59:23.539108 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:59:23.539083    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb003c1f_2811_4f0b_91c4_a9b605533bb5.slice/crio-873c709e4f7576013c5cca64fb695ea64937cf2dd8640b8e1b7373b877afe71e WatchSource:0}: Error finding container 873c709e4f7576013c5cca64fb695ea64937cf2dd8640b8e1b7373b877afe71e: Status 404 returned error can't find the container with id 873c709e4f7576013c5cca64fb695ea64937cf2dd8640b8e1b7373b877afe71e
Sep 09 23:59:23.797320 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.797291    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5" event={"ID":"9049ab7c-0af6-4c9e-a6ef-11b3be15c850","Type":"ContainerStarted","Data":"162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599"}
Sep 09 23:59:23.797502 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.797346    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5" event={"ID":"9049ab7c-0af6-4c9e-a6ef-11b3be15c850","Type":"ContainerStarted","Data":"e68b2edf8cf21ea60631b61ba35310dd7b349aa4a80511fe569491eebc5ff16f"}
Sep 09 23:59:23.797502 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.797430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:23.799048 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.799026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk" event={"ID":"851a463e-069d-467c-9a0c-c414ba76d2cb","Type":"ContainerStarted","Data":"11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8"}
Sep 09 23:59:23.799165 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.799062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk" event={"ID":"851a463e-069d-467c-9a0c-c414ba76d2cb","Type":"ContainerStarted","Data":"9efd126f3a2ad53f7770d846ccf3a6396bdd195248278bd8a3097421d73556d4"}
Sep 09 23:59:23.799165 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.799089    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:23.799697 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.799672    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="71246607-7885-472b-a12c-0311b65b7c23" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:23.800780 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.800757    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m" event={"ID":"db003c1f-2811-4f0b-91c4-a9b605533bb5","Type":"ContainerStarted","Data":"a2b69bf38fbfa244116d09ac8919b36698f8e2c26c0630c5a7fd80d2106b2c8d"}
Sep 09 23:59:23.800872 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.800800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m" event={"ID":"db003c1f-2811-4f0b-91c4-a9b605533bb5","Type":"ContainerStarted","Data":"873c709e4f7576013c5cca64fb695ea64937cf2dd8640b8e1b7373b877afe71e"}
Sep 09 23:59:23.800961 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.800870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m"
Sep 09 23:59:23.802124 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.802103    2560 generic.go:356] "Generic (PLEG): container finished" podID="029a6c08-10ea-4a6b-a4be-297a62c10d11" containerID="18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d" exitCode=0
Sep 09 23:59:23.802235 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.802162    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:59:23.802235 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.802198    2560 scope.go:117] "RemoveContainer" containerID="18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d"
Sep 09 23:59:23.802404 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.802375    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:23.803682 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.803657    2560 generic.go:356] "Generic (PLEG): container finished" podID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" containerID="401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02" exitCode=0
Sep 09 23:59:23.803781 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.803711    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:23.805684 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.805658    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s" podUID="71246607-7885-472b-a12c-0311b65b7c23" containerName="manager" containerID="cri-o://54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291" gracePeriod=2
Sep 09 23:59:23.812321 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.812300    2560 scope.go:117] "RemoveContainer" containerID="18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d"
Sep 09 23:59:23.812683 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.812641    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d\": container with ID starting with 18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d not found: ID does not exist" containerID="18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d"
Sep 09 23:59:23.812983 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.812676    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d"} err="failed to get container status \"18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d\": rpc error: code = NotFound desc = could not find container \"18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d\": container with ID starting with 18799bdd2a5e8336b120d304f7db4db6f5481abb45a81e3e0f4d17b713fd9e6d not found: ID does not exist"
Sep 09 23:59:23.812983 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.812699    2560 scope.go:117] "RemoveContainer" containerID="401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02"
Sep 09 23:59:23.820551 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.820534    2560 scope.go:117] "RemoveContainer" containerID="401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02"
Sep 09 23:59:23.820808 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.820790    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02\": container with ID starting with 401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02 not found: ID does not exist" containerID="401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02"
Sep 09 23:59:23.820854 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.820814    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02"} err="failed to get container status \"401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02\": rpc error: code = NotFound desc = could not find container \"401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02\": container with ID starting with 401a2c21abfd1a5008174153ae5b81ba5c41b5277b9d82f290451401a4892a02 not found: ID does not exist"
Sep 09 23:59:23.824471 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.824427    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5" podStartSLOduration=1.8244149109999999 podStartE2EDuration="1.824414911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:59:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:59:23.823536634 +0000 UTC m=+637.955663860" watchObservedRunningTime="2026-09-09 23:59:23.824414911 +0000 UTC m=+637.956542138"
Sep 09 23:59:23.825681 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.825658    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vnfp2\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:59:23.827652 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.827629    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:23.864796 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.864745    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk" podStartSLOduration=1.864729136 podStartE2EDuration="1.864729136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:59:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:59:23.863094226 +0000 UTC m=+637.995221468" watchObservedRunningTime="2026-09-09 23:59:23.864729136 +0000 UTC m=+637.996856364"
Sep 09 23:59:23.865758 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.865732    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vnfp2\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:59:23.898164 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:23.898123    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="71246607-7885-472b-a12c-0311b65b7c23" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:23.899407 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:23.899367    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m" podStartSLOduration=1.8993529169999999 podStartE2EDuration="1.899352917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:59:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:59:23.895790172 +0000 UTC m=+638.027917400" watchObservedRunningTime="2026-09-09 23:59:23.899352917 +0000 UTC m=+638.031480145"
Sep 09 23:59:24.093534 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.093505    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:24.095756 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:24.095724    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mhvs7\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mhvs7"
Sep 09 23:59:24.097641 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:24.097610    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vnfp2\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vnfp2"
Sep 09 23:59:24.099360 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:24.099339    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="71246607-7885-472b-a12c-0311b65b7c23" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:24.110826 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.110805    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71246607-7885-472b-a12c-0311b65b7c23-extensions-socket-volume\") pod \"71246607-7885-472b-a12c-0311b65b7c23\" (UID: \"71246607-7885-472b-a12c-0311b65b7c23\") "
Sep 09 23:59:24.110916 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.110831    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs46d\" (UniqueName: \"kubernetes.io/projected/71246607-7885-472b-a12c-0311b65b7c23-kube-api-access-zs46d\") pod \"71246607-7885-472b-a12c-0311b65b7c23\" (UID: \"71246607-7885-472b-a12c-0311b65b7c23\") "
Sep 09 23:59:24.111190 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.111168    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71246607-7885-472b-a12c-0311b65b7c23-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "71246607-7885-472b-a12c-0311b65b7c23" (UID: "71246607-7885-472b-a12c-0311b65b7c23"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:59:24.112894 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.112873    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71246607-7885-472b-a12c-0311b65b7c23-kube-api-access-zs46d" (OuterVolumeSpecName: "kube-api-access-zs46d") pod "71246607-7885-472b-a12c-0311b65b7c23" (UID: "71246607-7885-472b-a12c-0311b65b7c23"). InnerVolumeSpecName "kube-api-access-zs46d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:59:24.211464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.211433    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71246607-7885-472b-a12c-0311b65b7c23-extensions-socket-volume\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:24.211464 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.211460    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs46d\" (UniqueName: \"kubernetes.io/projected/71246607-7885-472b-a12c-0311b65b7c23-kube-api-access-zs46d\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:24.339851 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.339769    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="029a6c08-10ea-4a6b-a4be-297a62c10d11" path="/var/lib/kubelet/pods/029a6c08-10ea-4a6b-a4be-297a62c10d11/volumes"
Sep 09 23:59:24.340182 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.340167    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25155b32-6cf0-4668-8e3b-6fb1a48abc72" path="/var/lib/kubelet/pods/25155b32-6cf0-4668-8e3b-6fb1a48abc72/volumes"
Sep 09 23:59:24.340482 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.340471    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71246607-7885-472b-a12c-0311b65b7c23" path="/var/lib/kubelet/pods/71246607-7885-472b-a12c-0311b65b7c23/volumes"
Sep 09 23:59:24.814216 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.814186    2560 generic.go:356] "Generic (PLEG): container finished" podID="71246607-7885-472b-a12c-0311b65b7c23" containerID="54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291" exitCode=0
Sep 09 23:59:24.814666 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.814234    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:24.814666 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.814279    2560 scope.go:117] "RemoveContainer" containerID="54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291"
Sep 09 23:59:24.818917 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:24.818888    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="71246607-7885-472b-a12c-0311b65b7c23" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:24.823000 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.822983    2560 scope.go:117] "RemoveContainer" containerID="54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291"
Sep 09 23:59:24.823274 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:24.823256    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291\": container with ID starting with 54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291 not found: ID does not exist" containerID="54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291"
Sep 09 23:59:24.823333 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:24.823281    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291"} err="failed to get container status \"54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291\": rpc error: code = NotFound desc = could not find container \"54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291\": container with ID starting with 54e2eb1db02b7479d20d0389464bf6ab96ea426e2c3cb08114504bad5d03f291 not found: ID does not exist"
Sep 09 23:59:25.883882 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:25.883849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:25.977263 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:25.977195    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:26.337445 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:26.337401    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gvj9s\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="71246607-7885-472b-a12c-0311b65b7c23" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gvj9s"
Sep 09 23:59:26.766915 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:26.766825    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ff5d7bb9c-x5klv" podUID="78d11374-ff92-4014-a618-1b0518812e89" containerName="console" containerID="cri-o://8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e" gracePeriod=15
Sep 09 23:59:27.022246 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.022185    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:59:27.033895 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.033872    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-service-ca\") pod \"78d11374-ff92-4014-a618-1b0518812e89\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") "
Sep 09 23:59:27.034029 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.033972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-trusted-ca-bundle\") pod \"78d11374-ff92-4014-a618-1b0518812e89\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") "
Sep 09 23:59:27.034029 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.034010    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-oauth-config\") pod \"78d11374-ff92-4014-a618-1b0518812e89\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") "
Sep 09 23:59:27.034152 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.034035    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-oauth-serving-cert\") pod \"78d11374-ff92-4014-a618-1b0518812e89\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") "
Sep 09 23:59:27.034152 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.034061    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-console-config\") pod \"78d11374-ff92-4014-a618-1b0518812e89\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") "
Sep 09 23:59:27.034152 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.034102    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-serving-cert\") pod \"78d11374-ff92-4014-a618-1b0518812e89\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") "
Sep 09 23:59:27.034306 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.034165    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l26tj\" (UniqueName: \"kubernetes.io/projected/78d11374-ff92-4014-a618-1b0518812e89-kube-api-access-l26tj\") pod \"78d11374-ff92-4014-a618-1b0518812e89\" (UID: \"78d11374-ff92-4014-a618-1b0518812e89\") "
Sep 09 23:59:27.034361 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.034337    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-service-ca" (OuterVolumeSpecName: "service-ca") pod "78d11374-ff92-4014-a618-1b0518812e89" (UID: "78d11374-ff92-4014-a618-1b0518812e89"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:59:27.034455 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.034429    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "78d11374-ff92-4014-a618-1b0518812e89" (UID: "78d11374-ff92-4014-a618-1b0518812e89"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:59:27.034514 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.034460    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:27.034514 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.034489    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78d11374-ff92-4014-a618-1b0518812e89" (UID: "78d11374-ff92-4014-a618-1b0518812e89"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:59:27.034514 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.034500    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-console-config" (OuterVolumeSpecName: "console-config") pod "78d11374-ff92-4014-a618-1b0518812e89" (UID: "78d11374-ff92-4014-a618-1b0518812e89"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:59:27.036242 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.036216    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78d11374-ff92-4014-a618-1b0518812e89" (UID: "78d11374-ff92-4014-a618-1b0518812e89"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:59:27.036336 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.036262    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78d11374-ff92-4014-a618-1b0518812e89" (UID: "78d11374-ff92-4014-a618-1b0518812e89"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:59:27.036415 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.036398    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78d11374-ff92-4014-a618-1b0518812e89-kube-api-access-l26tj" (OuterVolumeSpecName: "kube-api-access-l26tj") pod "78d11374-ff92-4014-a618-1b0518812e89" (UID: "78d11374-ff92-4014-a618-1b0518812e89"). InnerVolumeSpecName "kube-api-access-l26tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:59:27.135810 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.135769    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-trusted-ca-bundle\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:27.135810 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.135803    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-oauth-config\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:27.135810 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.135814    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-oauth-serving-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:27.136084 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.135823    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d11374-ff92-4014-a618-1b0518812e89-console-config\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:27.136084 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.135832    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d11374-ff92-4014-a618-1b0518812e89-console-serving-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:27.136084 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.135841    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l26tj\" (UniqueName: \"kubernetes.io/projected/78d11374-ff92-4014-a618-1b0518812e89-kube-api-access-l26tj\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:27.554583 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.554546    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:27.654698 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.654665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:27.831301 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.831213    2560 generic.go:356] "Generic (PLEG): container finished" podID="78d11374-ff92-4014-a618-1b0518812e89" containerID="8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e" exitCode=0
Sep 09 23:59:27.831301 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.831275    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff5d7bb9c-x5klv"
Sep 09 23:59:27.831301 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.831284    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff5d7bb9c-x5klv" event={"ID":"78d11374-ff92-4014-a618-1b0518812e89","Type":"ContainerDied","Data":"8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e"}
Sep 09 23:59:27.831543 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.831331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff5d7bb9c-x5klv" event={"ID":"78d11374-ff92-4014-a618-1b0518812e89","Type":"ContainerDied","Data":"d391e12cb11c4e59ec946c5919ec5f553ea88c8e06f88dc4dfb2e26087fbc2f4"}
Sep 09 23:59:27.831543 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.831357    2560 scope.go:117] "RemoveContainer" containerID="8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e"
Sep 09 23:59:27.840698 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.840679    2560 scope.go:117] "RemoveContainer" containerID="8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e"
Sep 09 23:59:27.840987 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:27.840968    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e\": container with ID starting with 8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e not found: ID does not exist" containerID="8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e"
Sep 09 23:59:27.841036 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.840996    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e"} err="failed to get container status \"8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e\": rpc error: code = NotFound desc = could not find container \"8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e\": container with ID starting with 8acafd52cd466df71e3277f72e03e54f04179197374374ecf074e39f9be0df3e not found: ID does not exist"
Sep 09 23:59:27.852514 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.852485    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff5d7bb9c-x5klv"]
Sep 09 23:59:27.853987 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:27.853967    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ff5d7bb9c-x5klv"]
Sep 09 23:59:28.339540 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:28.339509    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78d11374-ff92-4014-a618-1b0518812e89" path="/var/lib/kubelet/pods/78d11374-ff92-4014-a618-1b0518812e89/volumes"
Sep 09 23:59:29.592003 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:29.591963    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:29.645803 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:29.645772    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:29.832516 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:29.832481    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:29.933287 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:29.933206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:33.388567 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:33.388529    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:33.441412 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:33.441375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:34.816605 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:34.816576    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qw85m"
Sep 09 23:59:34.817055 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:34.816654    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:34.817055 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:34.816702    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:34.869367 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:34.869336    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"]
Sep 09 23:59:34.869792 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:34.869751    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5" podUID="9049ab7c-0af6-4c9e-a6ef-11b3be15c850" containerName="manager" containerID="cri-o://162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599" gracePeriod=10
Sep 09 23:59:35.120291 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.120266    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:35.203172 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.203135    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x86sl\" (UniqueName: \"kubernetes.io/projected/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-kube-api-access-x86sl\") pod \"9049ab7c-0af6-4c9e-a6ef-11b3be15c850\" (UID: \"9049ab7c-0af6-4c9e-a6ef-11b3be15c850\") "
Sep 09 23:59:35.203172 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.203178    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-extensions-socket-volume\") pod \"9049ab7c-0af6-4c9e-a6ef-11b3be15c850\" (UID: \"9049ab7c-0af6-4c9e-a6ef-11b3be15c850\") "
Sep 09 23:59:35.203583 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.203558    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9049ab7c-0af6-4c9e-a6ef-11b3be15c850" (UID: "9049ab7c-0af6-4c9e-a6ef-11b3be15c850"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:59:35.205298 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.205268    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-kube-api-access-x86sl" (OuterVolumeSpecName: "kube-api-access-x86sl") pod "9049ab7c-0af6-4c9e-a6ef-11b3be15c850" (UID: "9049ab7c-0af6-4c9e-a6ef-11b3be15c850"). InnerVolumeSpecName "kube-api-access-x86sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:59:35.210915 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.210893    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"]
Sep 09 23:59:35.211256 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.211242    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78d11374-ff92-4014-a618-1b0518812e89" containerName="console"
Sep 09 23:59:35.211304 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.211257    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="78d11374-ff92-4014-a618-1b0518812e89" containerName="console"
Sep 09 23:59:35.211304 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.211272    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9049ab7c-0af6-4c9e-a6ef-11b3be15c850" containerName="manager"
Sep 09 23:59:35.211304 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.211279    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9049ab7c-0af6-4c9e-a6ef-11b3be15c850" containerName="manager"
Sep 09 23:59:35.211399 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.211344    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9049ab7c-0af6-4c9e-a6ef-11b3be15c850" containerName="manager"
Sep 09 23:59:35.211399 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.211357    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="78d11374-ff92-4014-a618-1b0518812e89" containerName="console"
Sep 09 23:59:35.213369 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.213354    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 09 23:59:35.230872 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.230849    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"]
Sep 09 23:59:35.304696 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.304655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-2c72d\" (UID: \"054a0ee3-3117-4578-b0e4-eb41fdcc14e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 09 23:59:35.304889 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.304717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcn7c\" (UniqueName: \"kubernetes.io/projected/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-kube-api-access-xcn7c\") pod \"kuadrant-operator-controller-manager-5769f99d9f-2c72d\" (UID: \"054a0ee3-3117-4578-b0e4-eb41fdcc14e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 09 23:59:35.304889 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.304778    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x86sl\" (UniqueName: \"kubernetes.io/projected/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-kube-api-access-x86sl\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:35.304889 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.304792    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9049ab7c-0af6-4c9e-a6ef-11b3be15c850-extensions-socket-volume\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:35.406193 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.406103    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-2c72d\" (UID: \"054a0ee3-3117-4578-b0e4-eb41fdcc14e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 09 23:59:35.406193 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.406156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcn7c\" (UniqueName: \"kubernetes.io/projected/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-kube-api-access-xcn7c\") pod \"kuadrant-operator-controller-manager-5769f99d9f-2c72d\" (UID: \"054a0ee3-3117-4578-b0e4-eb41fdcc14e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 09 23:59:35.406487 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.406465    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-2c72d\" (UID: \"054a0ee3-3117-4578-b0e4-eb41fdcc14e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 09 23:59:35.417525 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.417491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcn7c\" (UniqueName: \"kubernetes.io/projected/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-kube-api-access-xcn7c\") pod \"kuadrant-operator-controller-manager-5769f99d9f-2c72d\" (UID: \"054a0ee3-3117-4578-b0e4-eb41fdcc14e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 09 23:59:35.522821 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.522780    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 09 23:59:35.796078 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.796055    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"]
Sep 09 23:59:35.798016 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:59:35.797992    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054a0ee3_3117_4578_b0e4_eb41fdcc14e6.slice/crio-ca601291f8798fd26ebcdb8e9925f88a1d45eb42cbbf59529d1630d426793544 WatchSource:0}: Error finding container ca601291f8798fd26ebcdb8e9925f88a1d45eb42cbbf59529d1630d426793544: Status 404 returned error can't find the container with id ca601291f8798fd26ebcdb8e9925f88a1d45eb42cbbf59529d1630d426793544
Sep 09 23:59:35.875817 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.875784    2560 generic.go:356] "Generic (PLEG): container finished" podID="9049ab7c-0af6-4c9e-a6ef-11b3be15c850" containerID="162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599" exitCode=0
Sep 09 23:59:35.876264 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.875822    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"
Sep 09 23:59:35.876264 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.875862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5" event={"ID":"9049ab7c-0af6-4c9e-a6ef-11b3be15c850","Type":"ContainerDied","Data":"162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599"}
Sep 09 23:59:35.876264 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.875910    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5" event={"ID":"9049ab7c-0af6-4c9e-a6ef-11b3be15c850","Type":"ContainerDied","Data":"e68b2edf8cf21ea60631b61ba35310dd7b349aa4a80511fe569491eebc5ff16f"}
Sep 09 23:59:35.876264 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.875957    2560 scope.go:117] "RemoveContainer" containerID="162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599"
Sep 09 23:59:35.878037 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.878006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" event={"ID":"054a0ee3-3117-4578-b0e4-eb41fdcc14e6","Type":"ContainerStarted","Data":"4a557def4a2ab71cdd888fc696420b2feaa9a8a062f4c8f5ee1bb83209ea5eb7"}
Sep 09 23:59:35.878140 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.878059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" event={"ID":"054a0ee3-3117-4578-b0e4-eb41fdcc14e6","Type":"ContainerStarted","Data":"ca601291f8798fd26ebcdb8e9925f88a1d45eb42cbbf59529d1630d426793544"}
Sep 09 23:59:35.878194 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.878136    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 09 23:59:35.893739 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.893720    2560 scope.go:117] "RemoveContainer" containerID="162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599"
Sep 09 23:59:35.894116 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:35.894093    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599\": container with ID starting with 162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599 not found: ID does not exist" containerID="162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599"
Sep 09 23:59:35.894215 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.894121    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599"} err="failed to get container status \"162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599\": rpc error: code = NotFound desc = could not find container \"162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599\": container with ID starting with 162add77d16968e7f14ab26471053b43aa10e4ef50eea68873592013a6aa4599 not found: ID does not exist"
Sep 09 23:59:35.901587 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.901544    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" podStartSLOduration=0.901532079 podStartE2EDuration="901.532079ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:59:35.899982804 +0000 UTC m=+650.032110032" watchObservedRunningTime="2026-09-09 23:59:35.901532079 +0000 UTC m=+650.033659306"
Sep 09 23:59:35.914850 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.914827    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"]
Sep 09 23:59:35.920751 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:35.920726    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-drdj5"]
Sep 09 23:59:36.339683 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:36.339646    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9049ab7c-0af6-4c9e-a6ef-11b3be15c850" path="/var/lib/kubelet/pods/9049ab7c-0af6-4c9e-a6ef-11b3be15c850/volumes"
Sep 09 23:59:37.535812 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:37.535769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:39.179061 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:39.179022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:39.280034 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:39.279998    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:39.336818 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:39.336779    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:40.746377 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:40.746335    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:46.887251 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:46.887219    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 09 23:59:46.939272 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:46.938986    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"]
Sep 09 23:59:46.939480 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:46.939445    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk" podUID="851a463e-069d-467c-9a0c-c414ba76d2cb" containerName="manager" containerID="cri-o://11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8" gracePeriod=10
Sep 09 23:59:47.188811 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.188790    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:47.314546 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.314512    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2dmp\" (UniqueName: \"kubernetes.io/projected/851a463e-069d-467c-9a0c-c414ba76d2cb-kube-api-access-j2dmp\") pod \"851a463e-069d-467c-9a0c-c414ba76d2cb\" (UID: \"851a463e-069d-467c-9a0c-c414ba76d2cb\") "
Sep 09 23:59:47.314698 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.314600    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/851a463e-069d-467c-9a0c-c414ba76d2cb-extensions-socket-volume\") pod \"851a463e-069d-467c-9a0c-c414ba76d2cb\" (UID: \"851a463e-069d-467c-9a0c-c414ba76d2cb\") "
Sep 09 23:59:47.315024 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.314995    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/851a463e-069d-467c-9a0c-c414ba76d2cb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "851a463e-069d-467c-9a0c-c414ba76d2cb" (UID: "851a463e-069d-467c-9a0c-c414ba76d2cb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:59:47.316700 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.316675    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/851a463e-069d-467c-9a0c-c414ba76d2cb-kube-api-access-j2dmp" (OuterVolumeSpecName: "kube-api-access-j2dmp") pod "851a463e-069d-467c-9a0c-c414ba76d2cb" (UID: "851a463e-069d-467c-9a0c-c414ba76d2cb"). InnerVolumeSpecName "kube-api-access-j2dmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:59:47.415430 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.415393    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/851a463e-069d-467c-9a0c-c414ba76d2cb-extensions-socket-volume\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:47.415430 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.415428    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2dmp\" (UniqueName: \"kubernetes.io/projected/851a463e-069d-467c-9a0c-c414ba76d2cb-kube-api-access-j2dmp\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 09 23:59:47.947756 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.947721    2560 generic.go:356] "Generic (PLEG): container finished" podID="851a463e-069d-467c-9a0c-c414ba76d2cb" containerID="11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8" exitCode=0
Sep 09 23:59:47.948265 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.947764    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"
Sep 09 23:59:47.948265 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.947796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk" event={"ID":"851a463e-069d-467c-9a0c-c414ba76d2cb","Type":"ContainerDied","Data":"11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8"}
Sep 09 23:59:47.948265 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.947856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk" event={"ID":"851a463e-069d-467c-9a0c-c414ba76d2cb","Type":"ContainerDied","Data":"9efd126f3a2ad53f7770d846ccf3a6396bdd195248278bd8a3097421d73556d4"}
Sep 09 23:59:47.948265 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.947879    2560 scope.go:117] "RemoveContainer" containerID="11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8"
Sep 09 23:59:47.961765 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.961745    2560 scope.go:117] "RemoveContainer" containerID="11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8"
Sep 09 23:59:47.962068 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:47.962039    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8\": container with ID starting with 11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8 not found: ID does not exist" containerID="11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8"
Sep 09 23:59:47.962137 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.962082    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8"} err="failed to get container status \"11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8\": rpc error: code = NotFound desc = could not find container \"11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8\": container with ID starting with 11fc654c7aafc6d98cedbbecb69f4bdbf46bbe2f666a56dc225a65fc1c2c26d8 not found: ID does not exist"
Sep 09 23:59:47.973982 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.973953    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"]
Sep 09 23:59:47.981048 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:47.981027    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-qk7xk"]
Sep 09 23:59:47.991104 ip-10-0-128-118 kubenswrapper[2560]: E0909 23:59:47.991078    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851a463e_069d_467c_9a0c_c414ba76d2cb.slice/crio-9efd126f3a2ad53f7770d846ccf3a6396bdd195248278bd8a3097421d73556d4\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851a463e_069d_467c_9a0c_c414ba76d2cb.slice\": RecentStats: unable to find data in memory cache]"
Sep 09 23:59:48.340005 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:48.339972    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="851a463e-069d-467c-9a0c-c414ba76d2cb" path="/var/lib/kubelet/pods/851a463e-069d-467c-9a0c-c414ba76d2cb/volumes"
Sep 09 23:59:51.117367 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.117333    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"]
Sep 09 23:59:51.117836 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.117688    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="851a463e-069d-467c-9a0c-c414ba76d2cb" containerName="manager"
Sep 09 23:59:51.117836 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.117701    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="851a463e-069d-467c-9a0c-c414ba76d2cb" containerName="manager"
Sep 09 23:59:51.117836 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.117756    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="851a463e-069d-467c-9a0c-c414ba76d2cb" containerName="manager"
Sep 09 23:59:51.122269 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.122240    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.124807 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.124782    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-72hk6\""
Sep 09 23:59:51.133183 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.133160    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"]
Sep 09 23:59:51.145965 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.145924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:51.248697 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.248662    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.248855 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.248729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.248855 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.248770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.248855 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.248786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.248855 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.248827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.249019 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.248891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct8cb\" (UniqueName: \"kubernetes.io/projected/d09b46f0-9ce3-4149-a211-e9d242c1d43b-kube-api-access-ct8cb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.249019 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.248917    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.249019 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.248975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.249113 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.249018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.349411 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.349411 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.349657 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.349657 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct8cb\" (UniqueName: \"kubernetes.io/projected/d09b46f0-9ce3-4149-a211-e9d242c1d43b-kube-api-access-ct8cb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.349657 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.349657 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349522    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.349657 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349574    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.349657 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.349974 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.349974 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.350087 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.349996    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.350087 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.350049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.350195 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.350145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.350323 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.350304    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.351974 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.351927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.352181 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.352162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.358503 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.358455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d09b46f0-9ce3-4149-a211-e9d242c1d43b-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.359367 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.359344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct8cb\" (UniqueName: \"kubernetes.io/projected/d09b46f0-9ce3-4149-a211-e9d242c1d43b-kube-api-access-ct8cb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-h77w6\" (UID: \"d09b46f0-9ce3-4149-a211-e9d242c1d43b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.433495 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.433407    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:51.707539 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.707477    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"]
Sep 09 23:59:51.710365 ip-10-0-128-118 kubenswrapper[2560]: W0909 23:59:51.710330    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09b46f0_9ce3_4149_a211_e9d242c1d43b.slice/crio-4f704b813f146810294f974b34bf331afc537e25eafe31b1c9196766243a7b84 WatchSource:0}: Error finding container 4f704b813f146810294f974b34bf331afc537e25eafe31b1c9196766243a7b84: Status 404 returned error can't find the container with id 4f704b813f146810294f974b34bf331afc537e25eafe31b1c9196766243a7b84
Sep 09 23:59:51.712942 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.712898    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:59:51.713013 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.712985    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:59:51.713054 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.713014    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:59:51.938558 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.938518    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 09 23:59:51.971553 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.971464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6" event={"ID":"d09b46f0-9ce3-4149-a211-e9d242c1d43b","Type":"ContainerStarted","Data":"38b27a43713aef2b030c88c68095c41dee131b35d3128c4a873825c4274fe03e"}
Sep 09 23:59:51.971553 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.971519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6" event={"ID":"d09b46f0-9ce3-4149-a211-e9d242c1d43b","Type":"ContainerStarted","Data":"4f704b813f146810294f974b34bf331afc537e25eafe31b1c9196766243a7b84"}
Sep 09 23:59:51.990760 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:51.990692    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6" podStartSLOduration=0.990666432 podStartE2EDuration="990.666432ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:59:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:59:51.988505268 +0000 UTC m=+666.120632497" watchObservedRunningTime="2026-09-09 23:59:51.990666432 +0000 UTC m=+666.122793662"
Sep 09 23:59:52.433712 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:52.433672    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:52.438413 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:52.438382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:52.976806 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:52.976771    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 09 23:59:52.977714 ip-10-0-128-118 kubenswrapper[2560]: I0909 23:59:52.977688    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 10 00:00:06.259501 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.259465    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:00:06.264270 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.264248    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"
Sep 10 00:00:06.266780 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.266731    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 00:00:06.266910 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.266822    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ptvt2\""
Sep 10 00:00:06.271547 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.271525    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:00:06.303157 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.303123    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:00:06.379994 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.379953    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1a2399c3-207b-49ff-9874-83d572e9f7e2-config-file\") pod \"limitador-limitador-84994f7ffc-6wxtk\" (UID: \"1a2399c3-207b-49ff-9874-83d572e9f7e2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"
Sep 10 00:00:06.380155 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.380049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-486qp\" (UniqueName: \"kubernetes.io/projected/1a2399c3-207b-49ff-9874-83d572e9f7e2-kube-api-access-486qp\") pod \"limitador-limitador-84994f7ffc-6wxtk\" (UID: \"1a2399c3-207b-49ff-9874-83d572e9f7e2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"
Sep 10 00:00:06.430190 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.430141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:06.481418 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.481378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1a2399c3-207b-49ff-9874-83d572e9f7e2-config-file\") pod \"limitador-limitador-84994f7ffc-6wxtk\" (UID: \"1a2399c3-207b-49ff-9874-83d572e9f7e2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"
Sep 10 00:00:06.481601 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.481465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-486qp\" (UniqueName: \"kubernetes.io/projected/1a2399c3-207b-49ff-9874-83d572e9f7e2-kube-api-access-486qp\") pod \"limitador-limitador-84994f7ffc-6wxtk\" (UID: \"1a2399c3-207b-49ff-9874-83d572e9f7e2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"
Sep 10 00:00:06.482027 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.482003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1a2399c3-207b-49ff-9874-83d572e9f7e2-config-file\") pod \"limitador-limitador-84994f7ffc-6wxtk\" (UID: \"1a2399c3-207b-49ff-9874-83d572e9f7e2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"
Sep 10 00:00:06.485778 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.485755    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:06.489460 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.489436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-486qp\" (UniqueName: \"kubernetes.io/projected/1a2399c3-207b-49ff-9874-83d572e9f7e2-kube-api-access-486qp\") pod \"limitador-limitador-84994f7ffc-6wxtk\" (UID: \"1a2399c3-207b-49ff-9874-83d572e9f7e2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"
Sep 10 00:00:06.596824 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.596795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"
Sep 10 00:00:06.620817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.620779    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:06.673387 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.673355    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:06.873410 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:06.873386    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:00:06.875527 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:00:06.875499    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2399c3_207b_49ff_9874_83d572e9f7e2.slice/crio-87182efb0258cfb427edb47cfd1fb0317f2c59ebbe60ba6ffb515c6012a2354f WatchSource:0}: Error finding container 87182efb0258cfb427edb47cfd1fb0317f2c59ebbe60ba6ffb515c6012a2354f: Status 404 returned error can't find the container with id 87182efb0258cfb427edb47cfd1fb0317f2c59ebbe60ba6ffb515c6012a2354f
Sep 10 00:00:07.047272 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:07.047226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk" event={"ID":"1a2399c3-207b-49ff-9874-83d572e9f7e2","Type":"ContainerStarted","Data":"87182efb0258cfb427edb47cfd1fb0317f2c59ebbe60ba6ffb515c6012a2354f"}
Sep 10 00:00:15.088550 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:15.088512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk" event={"ID":"1a2399c3-207b-49ff-9874-83d572e9f7e2","Type":"ContainerStarted","Data":"0ae00f82232069271dbec311339c0238156d623259f0f1b4542a414f1a75282a"}
Sep 10 00:00:15.088973 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:15.088656    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"
Sep 10 00:00:15.108297 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:15.108249    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk" podStartSLOduration=1.525028443 podStartE2EDuration="9.108234748s" totalImagesPullingTime="7.583206305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:00:15.107217837 +0000 UTC m=+689.239345063" watchObservedRunningTime="2026-09-10 00:00:15.108234748 +0000 UTC m=+689.240361976"
Sep 10 00:00:26.097620 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:26.097583    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"
Sep 10 00:00:29.475332 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:29.475301    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:29.735514 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:29.735429    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:29.960719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:29.960687    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:39.424279 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:39.424192    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:39.677132 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:39.677045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:45.744675 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:45.744640    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:45.814893 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:45.814864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:45.881231 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:45.881197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:46.217412 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:46.217378    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:46.419320 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:46.419285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:49.930562 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:49.930521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:50.176025 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:50.175991    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:00:52.388291 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:00:52.388261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:21.137032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:21.136996    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:21.233497 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:21.233463    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:22.530511 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:22.530456    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:23.040135 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:23.040088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:23.140356 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:23.140319    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:23.199476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:23.199446    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:01:23.237466 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:23.237439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:32.460542 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:32.460464    2560 generic.go:356] "Generic (PLEG): container finished" podID="d09b46f0-9ce3-4149-a211-e9d242c1d43b" containerID="38b27a43713aef2b030c88c68095c41dee131b35d3128c4a873825c4274fe03e" exitCode=0
Sep 10 00:01:32.461071 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:32.460540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6" event={"ID":"d09b46f0-9ce3-4149-a211-e9d242c1d43b","Type":"ContainerDied","Data":"38b27a43713aef2b030c88c68095c41dee131b35d3128c4a873825c4274fe03e"}
Sep 10 00:01:32.461154 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:32.461076    2560 scope.go:117] "RemoveContainer" containerID="38b27a43713aef2b030c88c68095c41dee131b35d3128c4a873825c4274fe03e"
Sep 10 00:01:32.462147 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:32.462119    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:01:32.462219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:32.462202    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:01:32.462266 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:32.462256    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:01:33.364437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:33.364375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:33.469619 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:33.469571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:33.472326 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:33.472296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6" event={"ID":"d09b46f0-9ce3-4149-a211-e9d242c1d43b","Type":"ContainerStarted","Data":"75a719386f8f28bece65f3197cc584cff1bd7991d983db942f26300baa9c78ff"}
Sep 10 00:01:34.434068 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:34.434033    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 10 00:01:34.434799 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:34.434776    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-h77w6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 00:01:34.434860 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:34.434827    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6" podUID="d09b46f0-9ce3-4149-a211-e9d242c1d43b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 00:01:35.434423 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:35.434388    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-h77w6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 00:01:35.434816 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:35.434460    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6" podUID="d09b46f0-9ce3-4149-a211-e9d242c1d43b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 00:01:36.433740 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:36.433704    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-h77w6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 00:01:36.433925 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:36.433765    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6" podUID="d09b46f0-9ce3-4149-a211-e9d242c1d43b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 00:01:37.433971 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:37.433918    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-h77w6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 00:01:37.434442 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:37.434000    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6" podUID="d09b46f0-9ce3-4149-a211-e9d242c1d43b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 00:01:37.976696 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:37.976654    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 10 00:01:38.437987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:38.437954    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 10 00:01:38.497863 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:38.497836    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6"
Sep 10 00:01:39.091105 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:39.091072    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:39.600472 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:39.600432    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:01:48.480679 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:48.480640    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:49.092658 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:49.092624    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:01:57.760672 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:57.760639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:01:58.599839 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:01:58.599804    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:02:10.884597 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:02:10.884518    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:02:12.200680 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:02:12.200649    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:02:22.765707 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:02:22.765671    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:02:24.104253 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:02:24.104215    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:02:28.486985 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:02:28.486949    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:02:30.305622 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:02:30.305590    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:02:36.667347 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:02:36.667293    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:02:38.803667 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:02:38.803632    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:03:31.760829 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:03:31.760788    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:03:33.119381 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:03:33.119342    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:03:44.618380 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:03:44.618305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:03:44.716048 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:03:44.716009    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:03:45.754025 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:03:45.753993    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:03:45.851035 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:03:45.851004    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:03:46.315724 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:03:46.315695    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:03:46.316515 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:03:46.316493    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:04:01.521292 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.521256    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:01.621452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.621420    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:01.722009 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.721971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:01.822497 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.822467    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"]
Sep 10 00:04:01.824833 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.824811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:01.827469 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.827449    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-f0f965-openshift-default-dockercfg-ddp2n\""
Sep 10 00:04:01.840296 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.840270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"]
Sep 10 00:04:01.850926 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.850897    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:01.886618 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.886582    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"]
Sep 10 00:04:01.889244 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.889221    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:01.892241 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.892217    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-cc0040-openshift-default-dockercfg-4cnr5\""
Sep 10 00:04:01.901168 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.901137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"]
Sep 10 00:04:01.935528 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-envoy\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:01.935727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfw5m\" (UniqueName: \"kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-kube-api-access-xfw5m\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:01.935727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-token\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:01.935727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-data\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:01.935727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ae2bcf-a251-4378-82c5-ac36019974be-istiod-ca-cert\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:01.935727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-data\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:01.935951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-podinfo\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:01.935951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ae2bcf-a251-4378-82c5-ac36019974be-istio-podinfo\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:01.935951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-socket\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:01.935951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-credential-socket\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:01.935951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-certs\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:01.936127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.935972    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-credential-socket\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:01.936127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.936025    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-istio-token\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:01.936127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.936043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ae95fe6-7411-47bc-9525-5f19f6280a03-istiod-ca-cert\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:01.936127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.936063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbfr9\" (UniqueName: \"kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-kube-api-access-pbfr9\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:01.936127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.936082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-socket\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:01.936127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.936103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-certs\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:01.936402 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.936129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-envoy\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:01.944260 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.944228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:01.961468 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.961400    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"]
Sep 10 00:04:01.964386 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.964361    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:01.966711 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.966692    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-01b7d5-openshift-default-dockercfg-zdglf\""
Sep 10 00:04:01.979844 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:01.979805    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"]
Sep 10 00:04:02.037195 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-credential-socket\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.037195 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-token\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.037402 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-istio-token\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.037402 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ae95fe6-7411-47bc-9525-5f19f6280a03-istiod-ca-cert\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.037402 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbfr9\" (UniqueName: \"kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-kube-api-access-pbfr9\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.037536 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-socket\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.037536 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-certs\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.037643 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-credential-socket\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.037643 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-envoy\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.037753 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-envoy\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.037753 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-credential-socket\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.037753 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfw5m\" (UniqueName: \"kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-kube-api-access-xfw5m\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.037753 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-token\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.038000 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-socket\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.038000 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.037854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-certs\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.038191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-envoy\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.038191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038120    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-data\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.038191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ae2bcf-a251-4378-82c5-ac36019974be-istiod-ca-cert\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.038191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-data\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.038384 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-podinfo\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.038384 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ae2bcf-a251-4378-82c5-ac36019974be-istio-podinfo\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.038384 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ae95fe6-7411-47bc-9525-5f19f6280a03-istiod-ca-cert\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.038384 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-data\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.038604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038389    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpfzr\" (UniqueName: \"kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-kube-api-access-jpfzr\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.038604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-socket\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.038604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-data\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.038604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-socket\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.038604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-data\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.038604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-podinfo\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.038604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038579    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-credential-socket\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.039109 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-certs\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.039109 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cae0a688-0af0-4eb1-89d1-677f0389ba99-istiod-ca-cert\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.039109 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-socket\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.039109 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.038997    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ae2bcf-a251-4378-82c5-ac36019974be-istiod-ca-cert\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.039109 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.039026    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-credential-socket\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.039450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.039112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-certs\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.039450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.039176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-certs\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.040310 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.040277    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-envoy\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.040733 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.040707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-envoy\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.040860 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.040844    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-podinfo\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.041161 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.041144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ae2bcf-a251-4378-82c5-ac36019974be-istio-podinfo\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.043714 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.043684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:02.045878 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.045856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-istio-token\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.046437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.046409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfw5m\" (UniqueName: \"kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-kube-api-access-xfw5m\") pod \"e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") " pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.046509 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.046487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-token\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.046858 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.046838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbfr9\" (UniqueName: \"kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-kube-api-access-pbfr9\") pod \"e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") " pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.134864 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.134823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:02.140102 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-credential-socket\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140188 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-envoy\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140242 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-data\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140242 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpfzr\" (UniqueName: \"kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-kube-api-access-jpfzr\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-socket\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-podinfo\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140453 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-credential-socket\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140550 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cae0a688-0af0-4eb1-89d1-677f0389ba99-istiod-ca-cert\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140622 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-certs\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140622 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-socket\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140622 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-data\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140774 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-token\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.140911 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.140890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-certs\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.141192 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.141173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cae0a688-0af0-4eb1-89d1-677f0389ba99-istiod-ca-cert\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.142442 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.142393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-envoy\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.143147 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.143126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-podinfo\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.144332 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.144302    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:02.148547 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.148523    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-token\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.149014 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.148982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpfzr\" (UniqueName: \"kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-kube-api-access-jpfzr\") pod \"e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") " pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.202515 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.201519    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:02.244439 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.244405    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:02.282391 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.282345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:02.344695 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.344147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:02.418013 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.417989    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"]
Sep 10 00:04:02.420472 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:04:02.420446    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae95fe6_7411_47bc_9525_5f19f6280a03.slice/crio-aa59e8bf41f676964d5ad4b60f5d74a5950ed0456567efe02ef866f501b08aab WatchSource:0}: Error finding container aa59e8bf41f676964d5ad4b60f5d74a5950ed0456567efe02ef866f501b08aab: Status 404 returned error can't find the container with id aa59e8bf41f676964d5ad4b60f5d74a5950ed0456567efe02ef866f501b08aab
Sep 10 00:04:02.422676 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.422646    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:02.422745 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.422710    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:02.422745 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.422736    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:02.484951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.484910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"]
Sep 10 00:04:02.486724 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:04:02.486704    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ae2bcf_a251_4378_82c5_ac36019974be.slice/crio-500f0e26fba31bfe720f3cdab0d615e69047abf6eaf0bbf475f02baa0651e52c WatchSource:0}: Error finding container 500f0e26fba31bfe720f3cdab0d615e69047abf6eaf0bbf475f02baa0651e52c: Status 404 returned error can't find the container with id 500f0e26fba31bfe720f3cdab0d615e69047abf6eaf0bbf475f02baa0651e52c
Sep 10 00:04:02.489324 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.489293    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:02.489422 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.489373    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:02.489479 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.489417    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:02.560461 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.560433    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"]
Sep 10 00:04:02.563735 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:04:02.563696    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae0a688_0af0_4eb1_89d1_677f0389ba99.slice/crio-675eff68c650f8a0234e1eb3fcdc539536db7d3801791c71f6dfdea48f69a221 WatchSource:0}: Error finding container 675eff68c650f8a0234e1eb3fcdc539536db7d3801791c71f6dfdea48f69a221: Status 404 returned error can't find the container with id 675eff68c650f8a0234e1eb3fcdc539536db7d3801791c71f6dfdea48f69a221
Sep 10 00:04:02.566639 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.566606    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:02.567009 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.566685    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:02.567009 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.566723    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:02.907452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:02.907342    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:03.001869 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.001836    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:03.205915 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.205786    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" event={"ID":"cae0a688-0af0-4eb1-89d1-677f0389ba99","Type":"ContainerStarted","Data":"3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38"}
Sep 10 00:04:03.205915 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.205851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" event={"ID":"cae0a688-0af0-4eb1-89d1-677f0389ba99","Type":"ContainerStarted","Data":"675eff68c650f8a0234e1eb3fcdc539536db7d3801791c71f6dfdea48f69a221"}
Sep 10 00:04:03.207830 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.207796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" event={"ID":"90ae2bcf-a251-4378-82c5-ac36019974be","Type":"ContainerStarted","Data":"56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3"}
Sep 10 00:04:03.207994 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.207861    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" event={"ID":"90ae2bcf-a251-4378-82c5-ac36019974be","Type":"ContainerStarted","Data":"500f0e26fba31bfe720f3cdab0d615e69047abf6eaf0bbf475f02baa0651e52c"}
Sep 10 00:04:03.209499 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.209470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" event={"ID":"9ae95fe6-7411-47bc-9525-5f19f6280a03","Type":"ContainerStarted","Data":"bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296"}
Sep 10 00:04:03.209598 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.209516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" event={"ID":"9ae95fe6-7411-47bc-9525-5f19f6280a03","Type":"ContainerStarted","Data":"aa59e8bf41f676964d5ad4b60f5d74a5950ed0456567efe02ef866f501b08aab"}
Sep 10 00:04:03.228410 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.228368    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" podStartSLOduration=2.228352508 podStartE2EDuration="2.228352508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:03.227592217 +0000 UTC m=+917.359719468" watchObservedRunningTime="2026-09-10 00:04:03.228352508 +0000 UTC m=+917.360479738"
Sep 10 00:04:03.244678 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.244634    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" podStartSLOduration=2.244618255 podStartE2EDuration="2.244618255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:03.243047134 +0000 UTC m=+917.375174364" watchObservedRunningTime="2026-09-10 00:04:03.244618255 +0000 UTC m=+917.376745485"
Sep 10 00:04:03.261119 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.261071    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" podStartSLOduration=2.261055552 podStartE2EDuration="2.261055552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:03.259980181 +0000 UTC m=+917.392107402" watchObservedRunningTime="2026-09-10 00:04:03.261055552 +0000 UTC m=+917.393182781"
Sep 10 00:04:03.282927 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.282899    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:03.287618 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.287597    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:03.348331 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:03.348305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:04.135201 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:04.135164    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:04.140304 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:04.140276    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:04.202437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:04.202406    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:04.206896 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:04.206872    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:04.215277 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:04.215252    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:04.215624 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:04.215598    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:04.215759 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:04.215648    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:04.216098 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:04.216077    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:04.216278 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:04.216261    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:04.216345 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:04.216333    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:05.117911 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:05.117879    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:05.222894 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:05.222849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:05.321005 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:05.320975    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:05.418610 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:05.418498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:05.513038 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:05.512999    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:04:06.518488 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:06.518443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:06.619702 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:06.619659    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:06.717048 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:06.717016    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:07.095990 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:07.095953    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:07.170546 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:07.170502    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:07.465479 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:07.465374    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:07.566059 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:07.566026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:07.668423 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:07.668381    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:08.024280 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:08.024253    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:08.124022 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:08.123987    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:08.663239 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:08.663199    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:08.728783 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:08.728740    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:08.910537 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:08.910501    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7801-6e0686"]
Sep 10 00:04:08.913601 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:08.913549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:08.916257 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:08.916234    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gtwx5\""
Sep 10 00:04:08.917763 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:08.917742    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7801-6e0686"]
Sep 10 00:04:09.014862 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.014829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pkpp\" (UniqueName: \"kubernetes.io/projected/310b81af-f730-4173-8d14-eebddbe1d484-kube-api-access-5pkpp\") pod \"test-curl-7801-6e0686\" (UID: \"310b81af-f730-4173-8d14-eebddbe1d484\") " pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:09.040854 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.040817    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:09.116079 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.116049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pkpp\" (UniqueName: \"kubernetes.io/projected/310b81af-f730-4173-8d14-eebddbe1d484-kube-api-access-5pkpp\") pod \"test-curl-7801-6e0686\" (UID: \"310b81af-f730-4173-8d14-eebddbe1d484\") " pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:09.125886 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.125855    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pkpp\" (UniqueName: \"kubernetes.io/projected/310b81af-f730-4173-8d14-eebddbe1d484-kube-api-access-5pkpp\") pod \"test-curl-7801-6e0686\" (UID: \"310b81af-f730-4173-8d14-eebddbe1d484\") " pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:09.141285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.141253    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:09.205010 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.204880    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:09.223962 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.223916    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:09.419335 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.419304    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:09.482681 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.482604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:09.499440 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.499414    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7801-6e0686"]
Sep 10 00:04:09.501457 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:04:09.501433    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod310b81af_f730_4173_8d14_eebddbe1d484.slice/crio-7e777c3793a85f025d4c3816c89b2a4177a207582bfcdb0d2238b7c1f0adeb38 WatchSource:0}: Error finding container 7e777c3793a85f025d4c3816c89b2a4177a207582bfcdb0d2238b7c1f0adeb38: Status 404 returned error can't find the container with id 7e777c3793a85f025d4c3816c89b2a4177a207582bfcdb0d2238b7c1f0adeb38
Sep 10 00:04:09.503297 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.503275    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 00:04:09.919956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.917617    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"]
Sep 10 00:04:09.922961 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.922919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:09.926735 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.926698    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-46484ed0-openshift-default-dockercfg-srpvn\""
Sep 10 00:04:09.932636 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:09.932600    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"]
Sep 10 00:04:10.026599 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.026559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhxbf\" (UniqueName: \"kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-kube-api-access-lhxbf\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.026800 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.026663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-data\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.026800 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.026739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-podinfo\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.026800 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.026764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-socket\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.027003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.026803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-envoy\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.027003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.026836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-token\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.027003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.026876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istiod-ca-cert\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.027003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.026903    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-credential-socket\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.027003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.026980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-certs\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.127786 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.127740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-token\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.127786 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.127789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istiod-ca-cert\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.127810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-credential-socket\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.127834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-certs\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.127862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhxbf\" (UniqueName: \"kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-kube-api-access-lhxbf\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.127909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-data\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.128000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-podinfo\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.128027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-socket\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.128066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-envoy\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.128396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-certs\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.128437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-data\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128555 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.128533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-credential-socket\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128610 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.128550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-socket\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.128658 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.128639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istiod-ca-cert\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.130569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.130546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-podinfo\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.130654 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.130593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-envoy\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.141235 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.141205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhxbf\" (UniqueName: \"kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-kube-api-access-lhxbf\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.142622 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.142596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-token\") pod \"e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") " pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.239532 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.239441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:10.254734 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.254701    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7801-6e0686" event={"ID":"310b81af-f730-4173-8d14-eebddbe1d484","Type":"ContainerStarted","Data":"7e777c3793a85f025d4c3816c89b2a4177a207582bfcdb0d2238b7c1f0adeb38"}
Sep 10 00:04:10.521490 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.521453    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"]
Sep 10 00:04:10.523228 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:04:10.523200    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ebc282f_52c0_4005_9c28_3ac92e4ee036.slice/crio-259abad87f3213c534835dce71bc1fde29c23f71e323105c178c42df5d3ca2b3 WatchSource:0}: Error finding container 259abad87f3213c534835dce71bc1fde29c23f71e323105c178c42df5d3ca2b3: Status 404 returned error can't find the container with id 259abad87f3213c534835dce71bc1fde29c23f71e323105c178c42df5d3ca2b3
Sep 10 00:04:10.525748 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.525713    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:10.525866 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.525789    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:10.525866 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:10.525837    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:11.263355 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:11.263302    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" event={"ID":"2ebc282f-52c0-4005-9c28-3ac92e4ee036","Type":"ContainerStarted","Data":"825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede"}
Sep 10 00:04:11.263775 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:11.263373    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" event={"ID":"2ebc282f-52c0-4005-9c28-3ac92e4ee036","Type":"ContainerStarted","Data":"259abad87f3213c534835dce71bc1fde29c23f71e323105c178c42df5d3ca2b3"}
Sep 10 00:04:11.282565 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:11.282513    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" podStartSLOduration=2.282497937 podStartE2EDuration="2.282497937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:11.280951631 +0000 UTC m=+925.413078850" watchObservedRunningTime="2026-09-10 00:04:11.282497937 +0000 UTC m=+925.414625165"
Sep 10 00:04:11.326136 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:11.326089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:12.240063 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:12.239973    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:12.245446 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:12.245421    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:12.270458 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:12.270422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7801-6e0686" event={"ID":"310b81af-f730-4173-8d14-eebddbe1d484","Type":"ContainerStarted","Data":"ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55"}
Sep 10 00:04:12.270850 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:12.270729    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:12.271536 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:12.271515    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:12.284827 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:12.284787    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7801-6e0686" podStartSLOduration=1.958380418 podStartE2EDuration="4.28477298s" totalImagesPullingTime="2.326392562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:12.283290575 +0000 UTC m=+926.415417803" watchObservedRunningTime="2026-09-10 00:04:12.28477298 +0000 UTC m=+926.416900208"
Sep 10 00:04:12.863701 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:12.863667    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7801-6e0686"]
Sep 10 00:04:12.869459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:12.869428    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7801-6e0686"]
Sep 10 00:04:13.077822 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.077785    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:13.178089 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.178054    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:13.276355 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:04:13.276327    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7801-6e0686" container="test-curl-7801-6e0686"
Sep 10 00:04:13.378076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.377977    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:13.716885 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.716806    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"]
Sep 10 00:04:13.717219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.717205    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="310b81af-f730-4173-8d14-eebddbe1d484" containerName="test-curl-7801-6e0686"
Sep 10 00:04:13.717262 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.717220    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="310b81af-f730-4173-8d14-eebddbe1d484" containerName="test-curl-7801-6e0686"
Sep 10 00:04:13.717301 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.717285    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="310b81af-f730-4173-8d14-eebddbe1d484" containerName="test-curl-7801-6e0686"
Sep 10 00:04:13.719438 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.719419    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.722330 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.722305    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-39c7cb-openshift-default-dockercfg-tmpzq\""
Sep 10 00:04:13.743737 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.743710    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"]
Sep 10 00:04:13.748107 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.748067    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:13.868991 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.868924    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvls9\" (UniqueName: \"kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-kube-api-access-mvls9\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.869335 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.869312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fab835e-6337-419a-b41e-659bca043d5e-istio-podinfo\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.869542 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.869523    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-socket\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.869767 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.869728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-istio-token\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.869977 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.869959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-envoy\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.870185 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.870136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-credential-socket\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.870368 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.870335    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fab835e-6337-419a-b41e-659bca043d5e-istiod-ca-cert\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.870552 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.870536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-certs\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.870740 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.870725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-data\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.948504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.948407    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:13.971817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.971705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvls9\" (UniqueName: \"kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-kube-api-access-mvls9\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.971817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.971761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fab835e-6337-419a-b41e-659bca043d5e-istio-podinfo\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.971817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.971808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-socket\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.972149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.971849    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-istio-token\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.972149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.971908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-envoy\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.972149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.971973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-credential-socket\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.972149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.972035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fab835e-6337-419a-b41e-659bca043d5e-istiod-ca-cert\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.972149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.972067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-certs\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.972149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.972107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-data\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.972692 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.972607    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-data\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.973109 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.973064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-credential-socket\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.973332 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.973306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-certs\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.973410 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.973375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-socket\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.973755 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.973715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fab835e-6337-419a-b41e-659bca043d5e-istiod-ca-cert\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.975406 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.975379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-envoy\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.975721 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.975696    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fab835e-6337-419a-b41e-659bca043d5e-istio-podinfo\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.985669 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.985644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-istio-token\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:13.985767 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:13.985747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvls9\" (UniqueName: \"kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-kube-api-access-mvls9\") pod \"e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") " pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:14.029601 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:14.029572    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:14.283263 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:14.283171    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7801-6e0686" podUID="310b81af-f730-4173-8d14-eebddbe1d484" containerName="test-curl-7801-6e0686" containerID="cri-o://ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55" gracePeriod=2
Sep 10 00:04:14.285592 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:04:14.285556    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7801-6e0686\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="310b81af-f730-4173-8d14-eebddbe1d484" pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:14.330472 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:14.330388    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"]
Sep 10 00:04:14.330585 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:04:14.330517    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fab835e_6337_419a_b41e_659bca043d5e.slice/crio-15369e0a0ac3744d6dbcf5772e8f228a2e8041e0ddd45a4a23d21cd6201128bb WatchSource:0}: Error finding container 15369e0a0ac3744d6dbcf5772e8f228a2e8041e0ddd45a4a23d21cd6201128bb: Status 404 returned error can't find the container with id 15369e0a0ac3744d6dbcf5772e8f228a2e8041e0ddd45a4a23d21cd6201128bb
Sep 10 00:04:14.333152 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:14.333113    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:14.333250 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:14.333197    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:14.333306 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:14.333245    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:15.294888 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:15.294839    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" event={"ID":"5fab835e-6337-419a-b41e-659bca043d5e","Type":"ContainerStarted","Data":"3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f"}
Sep 10 00:04:15.295414 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:15.294909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" event={"ID":"5fab835e-6337-419a-b41e-659bca043d5e","Type":"ContainerStarted","Data":"15369e0a0ac3744d6dbcf5772e8f228a2e8041e0ddd45a4a23d21cd6201128bb"}
Sep 10 00:04:15.316970 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:15.316885    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" podStartSLOduration=2.316862315 podStartE2EDuration="2.316862315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:15.313382184 +0000 UTC m=+929.445509415" watchObservedRunningTime="2026-09-10 00:04:15.316862315 +0000 UTC m=+929.448989546"
Sep 10 00:04:15.677214 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:15.677177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:16.031136 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:16.031039    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:16.037083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:16.037055    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:16.319969 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:16.319632    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:16.328484 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:16.326284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:16.791956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:16.791408    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:16.793731 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:04:16.793687    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7801-6e0686\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="310b81af-f730-4173-8d14-eebddbe1d484" pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:16.932877 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:16.932833    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pkpp\" (UniqueName: \"kubernetes.io/projected/310b81af-f730-4173-8d14-eebddbe1d484-kube-api-access-5pkpp\") pod \"310b81af-f730-4173-8d14-eebddbe1d484\" (UID: \"310b81af-f730-4173-8d14-eebddbe1d484\") "
Sep 10 00:04:16.935341 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:16.935306    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/310b81af-f730-4173-8d14-eebddbe1d484-kube-api-access-5pkpp" (OuterVolumeSpecName: "kube-api-access-5pkpp") pod "310b81af-f730-4173-8d14-eebddbe1d484" (UID: "310b81af-f730-4173-8d14-eebddbe1d484"). InnerVolumeSpecName "kube-api-access-5pkpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:04:17.034022 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:17.033914    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pkpp\" (UniqueName: \"kubernetes.io/projected/310b81af-f730-4173-8d14-eebddbe1d484-kube-api-access-5pkpp\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:04:17.312987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:17.312921    2560 generic.go:356] "Generic (PLEG): container finished" podID="310b81af-f730-4173-8d14-eebddbe1d484" containerID="ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55" exitCode=137
Sep 10 00:04:17.313812 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:17.313788    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:17.319893 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:17.319864    2560 scope.go:117] "RemoveContainer" containerID="ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55"
Sep 10 00:04:17.321589 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:04:17.321552    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7801-6e0686\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="310b81af-f730-4173-8d14-eebddbe1d484" pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:17.335035 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:04:17.334986    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7801-6e0686\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="310b81af-f730-4173-8d14-eebddbe1d484" pod="opendatahub/test-curl-7801-6e0686"
Sep 10 00:04:17.339192 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:17.339173    2560 scope.go:117] "RemoveContainer" containerID="ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55"
Sep 10 00:04:17.339568 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:04:17.339548    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55\": container with ID starting with ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55 not found: ID does not exist" containerID="ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55"
Sep 10 00:04:17.339665 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:17.339584    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55"} err="failed to get container status \"ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55\": rpc error: code = NotFound desc = could not find container \"ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55\": container with ID starting with ee83c98bfdf67c2615884c09957d17a16361e203c36916e52b8e47ac843e9e55 not found: ID does not exist"
Sep 10 00:04:17.464492 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:17.464454    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:17.565420 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:17.565307    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:18.340959 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:18.339840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:18.347968 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:18.345159    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="310b81af-f730-4173-8d14-eebddbe1d484" path="/var/lib/kubelet/pods/310b81af-f730-4173-8d14-eebddbe1d484/volumes"
Sep 10 00:04:18.440927 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:18.440893    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:18.500382 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:18.500343    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:18.835955 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:18.835541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:18.906955 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:18.905737    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:20.437118 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:20.437084    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:20.583359 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:20.583323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:20.691515 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:20.691463    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:20.815496 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:20.815459    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:23.428802 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:23.428757    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:24.499082 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:24.499052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:04:25.028157 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.028126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:25.373267 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.373236    2560 generic.go:356] "Generic (PLEG): container finished" podID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerID="bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296" exitCode=0
Sep 10 00:04:25.373452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.373307    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" event={"ID":"9ae95fe6-7411-47bc-9525-5f19f6280a03","Type":"ContainerDied","Data":"bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296"}
Sep 10 00:04:25.373805 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.373781    2560 scope.go:117] "RemoveContainer" containerID="bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296"
Sep 10 00:04:25.375000 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.374969    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:25.375081 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.375057    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:25.375124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.375079    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" event={"ID":"cae0a688-0af0-4eb1-89d1-677f0389ba99","Type":"ContainerDied","Data":"3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38"}
Sep 10 00:04:25.375124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.375104    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:25.375244 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.375060    2560 generic.go:356] "Generic (PLEG): container finished" podID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerID="3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38" exitCode=0
Sep 10 00:04:25.375473 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.375457    2560 scope.go:117] "RemoveContainer" containerID="3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38"
Sep 10 00:04:25.376690 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.376655    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:25.376792 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.376728    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:25.376792 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.376762    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:25.377151 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.377127    2560 generic.go:356] "Generic (PLEG): container finished" podID="90ae2bcf-a251-4378-82c5-ac36019974be" containerID="56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3" exitCode=0
Sep 10 00:04:25.377243 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.377195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" event={"ID":"90ae2bcf-a251-4378-82c5-ac36019974be","Type":"ContainerDied","Data":"56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3"}
Sep 10 00:04:25.377655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.377613    2560 scope.go:117] "RemoveContainer" containerID="56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3"
Sep 10 00:04:25.378599 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.378576    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:25.378682 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.378630    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:25.378682 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:25.378661    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:26.418369 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:26.418327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" event={"ID":"9ae95fe6-7411-47bc-9525-5f19f6280a03","Type":"ContainerStarted","Data":"5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee"}
Sep 10 00:04:26.432619 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:26.432484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" event={"ID":"cae0a688-0af0-4eb1-89d1-677f0389ba99","Type":"ContainerStarted","Data":"b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222"}
Sep 10 00:04:26.440695 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:26.439950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" event={"ID":"90ae2bcf-a251-4378-82c5-ac36019974be","Type":"ContainerStarted","Data":"77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e"}
Sep 10 00:04:27.136191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.136143    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:27.136421 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.136285    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 00:04:27.136421 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.136344    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 00:04:27.202414 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.202360    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 00:04:27.202601 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.202436    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 00:04:27.202746 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.202718    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:27.283535 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.283485    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 00:04:27.283754 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.283557    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 00:04:27.283866 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.283839    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:27.444407 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.430552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:27.519959 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:27.515365    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:28.136206 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:28.136152    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 00:04:28.136434 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:28.136236    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 00:04:28.202220 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:28.202175    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 00:04:28.202527 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:28.202480    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 00:04:28.283348 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:28.283307    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 00:04:28.283595 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:28.283567    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 00:04:28.643277 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:28.643235    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:29.135585 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:29.135542    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 00:04:29.135879 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:29.135844    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 00:04:29.202335 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:29.202296    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 00:04:29.202620 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:29.202588    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 00:04:29.283787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:29.283747    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 00:04:29.284525 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:29.284090    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 00:04:29.400006 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:29.399878    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:30.041107 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.041005    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:30.135979 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.135912    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 00:04:30.136313 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.136283    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 00:04:30.141860 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.141779    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:30.202602 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.202563    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 00:04:30.202895 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.202839    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 00:04:30.283099 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.283061    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 00:04:30.283412 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.283369    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 00:04:30.364711 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.364656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:30.477904 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.477837    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:30.575569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.575513    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:30.649439 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.649330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:30.657481 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.657446    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"]
Sep 10 00:04:30.663201 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.663167    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.666510 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.666485    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a6d968-openshift-default-dockercfg-p7hjb\""
Sep 10 00:04:30.717685 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.717629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-certs\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.718043 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.718015    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-envoy\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.718275 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.718255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-podinfo\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.718491 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.718471    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-credential-socket\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.718629 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.718614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-data\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.718809 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.718778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2741b33b-e20a-4b9d-8852-ab64f9f77515-istiod-ca-cert\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.719047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.719029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-socket\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.719218 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.719200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggkjj\" (UniqueName: \"kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-kube-api-access-ggkjj\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.719367 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.719351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-token\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.729480 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.729255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:30.733602 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.733576    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"]
Sep 10 00:04:30.821967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.820666    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2741b33b-e20a-4b9d-8852-ab64f9f77515-istiod-ca-cert\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.821967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.820715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-socket\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.821967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.820757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggkjj\" (UniqueName: \"kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-kube-api-access-ggkjj\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.821967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.820799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-token\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.821967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.820847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-certs\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.821967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.820881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-envoy\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.821967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.820972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-podinfo\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.821967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.821042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-credential-socket\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.821967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.821066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-data\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.821967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.821513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-data\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.822642 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.822173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2741b33b-e20a-4b9d-8852-ab64f9f77515-istiod-ca-cert\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.822642 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.822422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-socket\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.825957 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.823149    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-certs\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.825957 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.824080    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-credential-socket\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.841412 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.827648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-envoy\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.841412 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.832713    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-podinfo\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.841412 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.838478    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:30.841412 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.839305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggkjj\" (UniqueName: \"kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-kube-api-access-ggkjj\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.866039 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.865707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-token\") pod \"e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") " pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:30.957575 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.957379    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:30.987858 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:30.987568    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:31.136818 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:31.136344    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 00:04:31.136818 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:31.136408    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 00:04:31.202528 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:31.202480    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 00:04:31.202740 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:31.202551    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 00:04:31.304961 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:31.289378    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 00:04:31.304961 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:31.289441    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 00:04:31.524900 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:31.524801    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"]
Sep 10 00:04:31.533465 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:04:31.533420    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2741b33b_e20a_4b9d_8852_ab64f9f77515.slice/crio-f3eff0320c969bed0f472522e5c4d99e9d843bd54cb86f034290fb22e786cac5 WatchSource:0}: Error finding container f3eff0320c969bed0f472522e5c4d99e9d843bd54cb86f034290fb22e786cac5: Status 404 returned error can't find the container with id f3eff0320c969bed0f472522e5c4d99e9d843bd54cb86f034290fb22e786cac5
Sep 10 00:04:31.537647 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:31.536756    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:31.537647 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:31.536839    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:31.537647 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:31.536880    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:32.135836 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.135788    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 00:04:32.136066 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.135883    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 00:04:32.202840 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.202789    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 00:04:32.203336 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.202860    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 00:04:32.283107 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.283063    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 00:04:32.283288 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.283137    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 00:04:32.511032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.510917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" event={"ID":"2741b33b-e20a-4b9d-8852-ab64f9f77515","Type":"ContainerStarted","Data":"28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4"}
Sep 10 00:04:32.511032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.511000    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" event={"ID":"2741b33b-e20a-4b9d-8852-ab64f9f77515","Type":"ContainerStarted","Data":"f3eff0320c969bed0f472522e5c4d99e9d843bd54cb86f034290fb22e786cac5"}
Sep 10 00:04:32.554995 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.543922    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" podStartSLOduration=2.543896022 podStartE2EDuration="2.543896022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:32.530556291 +0000 UTC m=+946.662683521" watchObservedRunningTime="2026-09-10 00:04:32.543896022 +0000 UTC m=+946.676023253"
Sep 10 00:04:32.990983 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.990926    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:32.991367 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.991344    2560 patch_prober.go:28] interesting pod/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 00:04:32.991539 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:32.991514    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 00:04:33.135501 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:33.135458    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 00:04:33.135804 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:33.135773    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 00:04:33.203225 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:33.203180    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 00:04:33.203710 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:33.203253    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 00:04:33.283355 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:33.283251    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 00:04:33.283355 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:33.283339    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 00:04:33.997961 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:33.997908    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:34.215194 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.215152    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:34.216122 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.216090    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:34.216361 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.216347    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:34.283813 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.283715    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 00:04:34.284516 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.284099    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 00:04:34.411800 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.411766    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:34.508655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.508552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:34.518776 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.518740    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:34.528682 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.528652    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:34.530367 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.530317    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:04:34.531616 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.531528    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:04:34.609968 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.608512    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:34.615669 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:34.614170    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:04:35.287045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:35.287010    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:35.288269 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:35.288244    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:04:36.159003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:36.158962    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:36.257105 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:36.257056    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:36.466814 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:36.466724    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:36.698780 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:36.698752    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:36.800326 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:36.800296    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:37.124763 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:37.124667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:37.949804 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:37.949762    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:38.022734 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.022707    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"]
Sep 10 00:04:38.038646 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.038607    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"]
Sep 10 00:04:38.038789 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.038742    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"
Sep 10 00:04:38.041458 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.041435    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 00:04:38.041458 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.041449    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxc4l\""
Sep 10 00:04:38.114998 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.114963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3919c86-1d5a-451d-9451-4b10e73d36ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5\" (UID: \"d3919c86-1d5a-451d-9451-4b10e73d36ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"
Sep 10 00:04:38.215687 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.215617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3919c86-1d5a-451d-9451-4b10e73d36ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5\" (UID: \"d3919c86-1d5a-451d-9451-4b10e73d36ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"
Sep 10 00:04:38.216266 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.216247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3919c86-1d5a-451d-9451-4b10e73d36ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5\" (UID: \"d3919c86-1d5a-451d-9451-4b10e73d36ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"
Sep 10 00:04:38.401269 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.401231    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"
Sep 10 00:04:38.567085 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.567050    2560 generic.go:356] "Generic (PLEG): container finished" podID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerID="825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede" exitCode=0
Sep 10 00:04:38.567261 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.567122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" event={"ID":"2ebc282f-52c0-4005-9c28-3ac92e4ee036","Type":"ContainerDied","Data":"825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede"}
Sep 10 00:04:38.567645 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.567619    2560 scope.go:117] "RemoveContainer" containerID="825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede"
Sep 10 00:04:38.568890 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.568856    2560 generic.go:356] "Generic (PLEG): container finished" podID="5fab835e-6337-419a-b41e-659bca043d5e" containerID="3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f" exitCode=0
Sep 10 00:04:38.569003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.568892    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:38.569003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.568964    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" event={"ID":"5fab835e-6337-419a-b41e-659bca043d5e","Type":"ContainerDied","Data":"3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f"}
Sep 10 00:04:38.569003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.568983    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:38.569135 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.569024    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:38.569329 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.569315    2560 scope.go:117] "RemoveContainer" containerID="3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f"
Sep 10 00:04:38.570258 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.570229    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:38.570418 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.570395    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:38.570473 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.570453    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:38.570513 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.570486    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:38.675197 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:38.675115    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"]
Sep 10 00:04:38.677534 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:04:38.677497    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3919c86_1d5a_451d_9451_4b10e73d36ac.slice/crio-7d045a95e37dd6ec971291f0d2bc45f8710cd173af512ab7122f394d62df9b83 WatchSource:0}: Error finding container 7d045a95e37dd6ec971291f0d2bc45f8710cd173af512ab7122f394d62df9b83: Status 404 returned error can't find the container with id 7d045a95e37dd6ec971291f0d2bc45f8710cd173af512ab7122f394d62df9b83
Sep 10 00:04:39.581461 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:39.581419    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" event={"ID":"2ebc282f-52c0-4005-9c28-3ac92e4ee036","Type":"ContainerStarted","Data":"7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2"}
Sep 10 00:04:39.584978 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:39.584943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" event={"ID":"5fab835e-6337-419a-b41e-659bca043d5e","Type":"ContainerStarted","Data":"b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3"}
Sep 10 00:04:39.589155 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:39.589120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5" event={"ID":"d3919c86-1d5a-451d-9451-4b10e73d36ac","Type":"ContainerStarted","Data":"7d045a95e37dd6ec971291f0d2bc45f8710cd173af512ab7122f394d62df9b83"}
Sep 10 00:04:40.030413 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:40.030281    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:40.030413 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:40.030300    2560 patch_prober.go:28] interesting pod/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 00:04:40.030413 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:40.030346    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 00:04:40.239945 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:40.239898    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:40.241365 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:40.241334    2560 patch_prober.go:28] interesting pod/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 00:04:40.241509 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:40.241389    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 00:04:40.364955 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:40.364432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:41.030760 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:41.030407    2560 patch_prober.go:28] interesting pod/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 00:04:41.030760 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:41.030464    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 00:04:41.240836 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:41.240799    2560 patch_prober.go:28] interesting pod/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 00:04:41.241033 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:41.240880    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 00:04:42.030539 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:42.030502    2560 patch_prober.go:28] interesting pod/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 00:04:42.030712 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:42.030563    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 00:04:42.108667 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:42.082424    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:42.184957 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:42.182432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:42.240730 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:42.240407    2560 patch_prober.go:28] interesting pod/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 00:04:42.240730 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:42.240458    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 00:04:42.270957 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:42.270615    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:43.030111 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:43.030070    2560 patch_prober.go:28] interesting pod/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 00:04:43.030291 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:43.030138    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 00:04:43.240983 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:43.240723    2560 patch_prober.go:28] interesting pod/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 00:04:43.240983 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:43.240772    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 00:04:43.621328 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:43.621290    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5" event={"ID":"d3919c86-1d5a-451d-9451-4b10e73d36ac","Type":"ContainerStarted","Data":"e6c524782aade5e8cadcab3eaf4011677e6c9a2f9743a84655544bf6fe370576"}
Sep 10 00:04:43.641617 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:43.641563    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5" podStartSLOduration=1.252063803 podStartE2EDuration="5.64154883s" totalImagesPullingTime="4.389485027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:43.639535899 +0000 UTC m=+957.771663130" watchObservedRunningTime="2026-09-10 00:04:43.64154883 +0000 UTC m=+957.773676058"
Sep 10 00:04:43.689586 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:43.689512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:43.889220 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:43.889180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:43.943520 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:43.943475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:44.030465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:44.030428    2560 patch_prober.go:28] interesting pod/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 00:04:44.030644 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:44.030484    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 00:04:44.240160 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:44.240069    2560 patch_prober.go:28] interesting pod/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 00:04:44.240371 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:44.240348    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 00:04:44.629432 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:44.629390    2560 generic.go:356] "Generic (PLEG): container finished" podID="d3919c86-1d5a-451d-9451-4b10e73d36ac" containerID="e6c524782aade5e8cadcab3eaf4011677e6c9a2f9743a84655544bf6fe370576" exitCode=0
Sep 10 00:04:44.629828 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:44.629517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5" event={"ID":"d3919c86-1d5a-451d-9451-4b10e73d36ac","Type":"ContainerDied","Data":"e6c524782aade5e8cadcab3eaf4011677e6c9a2f9743a84655544bf6fe370576"}
Sep 10 00:04:45.030984 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:45.030883    2560 patch_prober.go:28] interesting pod/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 00:04:45.030984 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:45.030956    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 00:04:45.244475 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:45.244430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:45.245677 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:45.245652    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:04:45.789260 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:45.789233    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"
Sep 10 00:04:45.835196 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:45.835169    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3919c86-1d5a-451d-9451-4b10e73d36ac-maas-api-service-ca\") pod \"d3919c86-1d5a-451d-9451-4b10e73d36ac\" (UID: \"d3919c86-1d5a-451d-9451-4b10e73d36ac\") "
Sep 10 00:04:45.835501 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:45.835479    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3919c86-1d5a-451d-9451-4b10e73d36ac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d3919c86-1d5a-451d-9451-4b10e73d36ac" (UID: "d3919c86-1d5a-451d-9451-4b10e73d36ac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:04:45.936403 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:45.936328    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3919c86-1d5a-451d-9451-4b10e73d36ac-maas-api-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:04:46.034704 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:46.034665    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:46.034975 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:46.034954    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:46.035699 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:46.035681    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:04:46.640956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:46.640849    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"
Sep 10 00:04:46.640956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:46.640888    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5" event={"ID":"d3919c86-1d5a-451d-9451-4b10e73d36ac","Type":"ContainerDied","Data":"7d045a95e37dd6ec971291f0d2bc45f8710cd173af512ab7122f394d62df9b83"}
Sep 10 00:04:46.640956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:46.640950    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d045a95e37dd6ec971291f0d2bc45f8710cd173af512ab7122f394d62df9b83"
Sep 10 00:04:48.908792 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:48.908753    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:04:50.047836 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:50.047797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:50.155196 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:50.155154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:50.256857 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:50.256798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:50.389759 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:50.389658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:54.436232 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:54.436186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:54.791457 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:54.791347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:54.896976 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:54.896921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:54.921155 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:54.921117    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"]
Sep 10 00:04:54.923045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:54.923022    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46484ed0-lmjw5"]
Sep 10 00:04:54.953399 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:54.953360    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:55.050839 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.049610    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"]
Sep 10 00:04:55.050839 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.049952    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy" containerID="cri-o://7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2" gracePeriod=30
Sep 10 00:04:55.066527 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.066494    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:55.514881 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.514770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:55.581250 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.581208    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:55.809386 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.809353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:55.976038 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.975997    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"]
Sep 10 00:04:55.976702 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.976666    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3919c86-1d5a-451d-9451-4b10e73d36ac" containerName="revoke-keys"
Sep 10 00:04:55.976702 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.976702    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3919c86-1d5a-451d-9451-4b10e73d36ac" containerName="revoke-keys"
Sep 10 00:04:55.976900 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.976833    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3919c86-1d5a-451d-9451-4b10e73d36ac" containerName="revoke-keys"
Sep 10 00:04:55.980156 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.980135    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:55.982740 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.982720    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e214cef3-gw-openshift-default-dockercfg-6cpfj\""
Sep 10 00:04:55.994899 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.994875    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"]
Sep 10 00:04:55.999076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:55.999051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:56.037417 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.037383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istiod-ca-cert\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.037417 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.037432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-envoy\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.037657 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.037482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-socket\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.037657 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.037499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-data\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.037657 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.037522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-certs\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.037657 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.037585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-credential-socket\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.037657 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.037635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2kh9\" (UniqueName: \"kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-kube-api-access-z2kh9\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.037855 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.037680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-token\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.037855 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.037709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-podinfo\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.138632 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.138545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2kh9\" (UniqueName: \"kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-kube-api-access-z2kh9\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.138632 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.138597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-token\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.138632 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.138627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-podinfo\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.138906 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.138677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istiod-ca-cert\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.139009 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.138893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-envoy\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.139009 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.138999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-socket\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.139127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.139023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-data\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.139127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.139055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-certs\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.139224 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.139180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-credential-socket\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.139376 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.139349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-socket\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.139496 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.139391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-certs\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.139496 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.139448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-data\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.139609 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.139535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-credential-socket\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.139740 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.139724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istiod-ca-cert\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.141177 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.141152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-envoy\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.141410 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.141391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-podinfo\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.150160 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.150111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-token\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.150683 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.150664    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2kh9\" (UniqueName: \"kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-kube-api-access-z2kh9\") pod \"e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") " pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.290678 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.290639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:56.344089 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.344050    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3919c86-1d5a-451d-9451-4b10e73d36ac" path="/var/lib/kubelet/pods/d3919c86-1d5a-451d-9451-4b10e73d36ac/volumes"
Sep 10 00:04:56.514378 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.514287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:56.574116 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.574067    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"]
Sep 10 00:04:56.579330 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:04:56.579296    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8209e1c4_cba3_4b08_b651_bc2bfcb950e2.slice/crio-57fc8c55f0e3358194ea8fd7fa5b132b97af497f96191c69ef2cdbaa227bf6b9 WatchSource:0}: Error finding container 57fc8c55f0e3358194ea8fd7fa5b132b97af497f96191c69ef2cdbaa227bf6b9: Status 404 returned error can't find the container with id 57fc8c55f0e3358194ea8fd7fa5b132b97af497f96191c69ef2cdbaa227bf6b9
Sep 10 00:04:56.581776 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.581739    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:56.581871 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.581827    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:56.581965 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.581871    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:56.687124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.687080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:56.705370 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.705332    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" event={"ID":"8209e1c4-cba3-4b08-b651-bc2bfcb950e2","Type":"ContainerStarted","Data":"1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523"}
Sep 10 00:04:56.705529 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.705388    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" event={"ID":"8209e1c4-cba3-4b08-b651-bc2bfcb950e2","Type":"ContainerStarted","Data":"57fc8c55f0e3358194ea8fd7fa5b132b97af497f96191c69ef2cdbaa227bf6b9"}
Sep 10 00:04:56.787904 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:56.787783    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:57.220347 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:57.220311    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:57.292661 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:57.292618    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:57.307049 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:57.306911    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:57.327079 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:57.327025    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" podStartSLOduration=2.327006942 podStartE2EDuration="2.327006942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:04:56.725422177 +0000 UTC m=+970.857549416" watchObservedRunningTime="2026-09-10 00:04:57.327006942 +0000 UTC m=+971.459134174"
Sep 10 00:04:57.712561 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:57.712527    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:57.713619 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:57.713597    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:04:58.276881 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:58.276847    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:58.377292 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:58.377252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:58.502586 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:58.502551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:58.603949 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:58.603898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:58.703643 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:58.703605    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:58.921419 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:58.921318    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:04:59.731162 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:59.731120    2560 generic.go:356] "Generic (PLEG): container finished" podID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerID="28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4" exitCode=0
Sep 10 00:04:59.731415 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:59.731192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" event={"ID":"2741b33b-e20a-4b9d-8852-ab64f9f77515","Type":"ContainerDied","Data":"28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4"}
Sep 10 00:04:59.731730 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:59.731711    2560 scope.go:117] "RemoveContainer" containerID="28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4"
Sep 10 00:04:59.732796 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:59.732766    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:59.732889 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:59.732851    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:04:59.732970 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:04:59.732899    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:05:00.247241 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.247201    2560 patch_prober.go:28] interesting pod/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 00:05:00.247636 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.247263    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 00:05:00.539815 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.539787    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:05:00.584185 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.584128    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:00.587127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587104    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-envoy\") pod \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") "
Sep 10 00:05:00.587249 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587146    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istiod-ca-cert\") pod \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") "
Sep 10 00:05:00.587249 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587177    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-certs\") pod \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") "
Sep 10 00:05:00.587249 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587195    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-socket\") pod \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") "
Sep 10 00:05:00.587249 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587217    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-token\") pod \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") "
Sep 10 00:05:00.587384 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587308    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-podinfo\") pod \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") "
Sep 10 00:05:00.587384 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587357    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-credential-socket\") pod \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") "
Sep 10 00:05:00.587465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587441    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-data\") pod \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") "
Sep 10 00:05:00.587465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587439    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ebc282f-52c0-4005-9c28-3ac92e4ee036" (UID: "2ebc282f-52c0-4005-9c28-3ac92e4ee036"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:05:00.587563 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587467    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ebc282f-52c0-4005-9c28-3ac92e4ee036" (UID: "2ebc282f-52c0-4005-9c28-3ac92e4ee036"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:05:00.587653 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587635    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ebc282f-52c0-4005-9c28-3ac92e4ee036" (UID: "2ebc282f-52c0-4005-9c28-3ac92e4ee036"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:05:00.587721 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587656    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ebc282f-52c0-4005-9c28-3ac92e4ee036" (UID: "2ebc282f-52c0-4005-9c28-3ac92e4ee036"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:05:00.587721 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587666    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ebc282f-52c0-4005-9c28-3ac92e4ee036" (UID: "2ebc282f-52c0-4005-9c28-3ac92e4ee036"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:05:00.587721 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.587689    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhxbf\" (UniqueName: \"kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-kube-api-access-lhxbf\") pod \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\" (UID: \"2ebc282f-52c0-4005-9c28-3ac92e4ee036\") "
Sep 10 00:05:00.588173 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.588146    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:00.588290 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.588175    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:00.588290 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.588189    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:00.588290 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.588205    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:00.588290 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.588219    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:00.589725 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.589703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ebc282f-52c0-4005-9c28-3ac92e4ee036" (UID: "2ebc282f-52c0-4005-9c28-3ac92e4ee036"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:05:00.590098 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.590025    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-kube-api-access-lhxbf" (OuterVolumeSpecName: "kube-api-access-lhxbf") pod "2ebc282f-52c0-4005-9c28-3ac92e4ee036" (UID: "2ebc282f-52c0-4005-9c28-3ac92e4ee036"). InnerVolumeSpecName "kube-api-access-lhxbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:05:00.590387 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.590363    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ebc282f-52c0-4005-9c28-3ac92e4ee036" (UID: "2ebc282f-52c0-4005-9c28-3ac92e4ee036"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:05:00.590661 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.590635    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ebc282f-52c0-4005-9c28-3ac92e4ee036" (UID: "2ebc282f-52c0-4005-9c28-3ac92e4ee036"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:05:00.684647 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.684611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:00.689064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.689043    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhxbf\" (UniqueName: \"kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-kube-api-access-lhxbf\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:00.689155 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.689069    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:00.689155 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.689079    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:00.689155 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.689086    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc282f-52c0-4005-9c28-3ac92e4ee036-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:00.739405 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.739365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" event={"ID":"2741b33b-e20a-4b9d-8852-ab64f9f77515","Type":"ContainerStarted","Data":"412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2"}
Sep 10 00:05:00.741110 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.741087    2560 generic.go:356] "Generic (PLEG): container finished" podID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerID="7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2" exitCode=0
Sep 10 00:05:00.741244 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.741127    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"
Sep 10 00:05:00.741244 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.741157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" event={"ID":"2ebc282f-52c0-4005-9c28-3ac92e4ee036","Type":"ContainerDied","Data":"7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2"}
Sep 10 00:05:00.741244 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.741201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm" event={"ID":"2ebc282f-52c0-4005-9c28-3ac92e4ee036","Type":"ContainerDied","Data":"259abad87f3213c534835dce71bc1fde29c23f71e323105c178c42df5d3ca2b3"}
Sep 10 00:05:00.741244 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.741225    2560 scope.go:117] "RemoveContainer" containerID="7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2"
Sep 10 00:05:00.769276 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.769108    2560 scope.go:117] "RemoveContainer" containerID="825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede"
Sep 10 00:05:00.781624 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.781577    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"]
Sep 10 00:05:00.783694 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.783674    2560 scope.go:117] "RemoveContainer" containerID="7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2"
Sep 10 00:05:00.784060 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:05:00.784040    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2\": container with ID starting with 7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2 not found: ID does not exist" containerID="7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2"
Sep 10 00:05:00.784136 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.784069    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2"} err="failed to get container status \"7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2\": rpc error: code = NotFound desc = could not find container \"7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2\": container with ID starting with 7e1a8e7744f94f1d69394ef30dec77ad7a8ff56a389dcaa75bcaeb4597635cd2 not found: ID does not exist"
Sep 10 00:05:00.784136 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.784089    2560 scope.go:117] "RemoveContainer" containerID="825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede"
Sep 10 00:05:00.784320 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.784291    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm"]
Sep 10 00:05:00.784416 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:05:00.784344    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede\": container with ID starting with 825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede not found: ID does not exist" containerID="825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede"
Sep 10 00:05:00.784416 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.784367    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede"} err="failed to get container status \"825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede\": rpc error: code = NotFound desc = could not find container \"825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede\": container with ID starting with 825c8861e7c16b0635fad3e5bd747e1de044ed1a169e965ed469f0bc7a349ede not found: ID does not exist"
Sep 10 00:05:00.989121 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.989084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:05:00.990291 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.990263    2560 patch_prober.go:28] interesting pod/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 00:05:00.990418 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:00.990325    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 00:05:01.988542 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:01.988497    2560 patch_prober.go:28] interesting pod/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 00:05:01.988977 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:01.988606    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 00:05:02.339969 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:02.339914    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" path="/var/lib/kubelet/pods/2ebc282f-52c0-4005-9c28-3ac92e4ee036/volumes"
Sep 10 00:05:02.989165 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:02.989123    2560 patch_prober.go:28] interesting pod/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 00:05:02.989649 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:02.989199    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 00:05:03.989003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:03.988965    2560 patch_prober.go:28] interesting pod/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 00:05:03.989224 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:03.989029    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 00:05:04.528724 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:04.528686    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:05:04.989135 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:04.989098    2560 patch_prober.go:28] interesting pod/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 00:05:04.989404 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:04.989157    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 00:05:05.992830 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:05.992798    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:05:05.993982 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:05.993960    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:05:10.513831 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:10.513734    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:05:12.441124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:12.441091    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:14.940546 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:14.940509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:15.041529 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:15.041480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:20.901650 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:20.901612    2560 generic.go:356] "Generic (PLEG): container finished" podID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerID="1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523" exitCode=0
Sep 10 00:05:20.902093 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:20.901685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" event={"ID":"8209e1c4-cba3-4b08-b651-bc2bfcb950e2","Type":"ContainerDied","Data":"1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523"}
Sep 10 00:05:20.902198 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:20.902181    2560 scope.go:117] "RemoveContainer" containerID="1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523"
Sep 10 00:05:20.903325 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:20.903297    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:05:20.903387 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:20.903366    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:05:20.903423 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:20.903401    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:05:21.910070 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:21.910030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" event={"ID":"8209e1c4-cba3-4b08-b651-bc2bfcb950e2","Type":"ContainerStarted","Data":"6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964"}
Sep 10 00:05:22.291175 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:22.291074    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:05:22.291332 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:22.291274    2560 patch_prober.go:28] interesting pod/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 00:05:22.291383 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:22.291322    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 00:05:23.159861 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.159808    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"]
Sep 10 00:05:23.160493 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.160467    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy"
Sep 10 00:05:23.160580 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.160496    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy"
Sep 10 00:05:23.160641 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.160621    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy"
Sep 10 00:05:23.160706 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.160639    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy"
Sep 10 00:05:23.163150 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.163129    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"
Sep 10 00:05:23.168074 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.168053    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxc4l\""
Sep 10 00:05:23.170713 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.168287    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 00:05:23.173216 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.173197    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"]
Sep 10 00:05:23.228778 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.228745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c37355e8-c3b8-4256-97ff-669bf7822645-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2\" (UID: \"c37355e8-c3b8-4256-97ff-669bf7822645\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"
Sep 10 00:05:23.291641 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.291602    2560 patch_prober.go:28] interesting pod/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 00:05:23.291803 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.291673    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 00:05:23.329910 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.329874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c37355e8-c3b8-4256-97ff-669bf7822645-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2\" (UID: \"c37355e8-c3b8-4256-97ff-669bf7822645\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"
Sep 10 00:05:23.330487 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.330465    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c37355e8-c3b8-4256-97ff-669bf7822645-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2\" (UID: \"c37355e8-c3b8-4256-97ff-669bf7822645\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"
Sep 10 00:05:23.480564 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.480475    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"
Sep 10 00:05:23.750809 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.750714    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"]
Sep 10 00:05:23.921615 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:23.921580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2" event={"ID":"c37355e8-c3b8-4256-97ff-669bf7822645","Type":"ContainerStarted","Data":"a2ecb616e3455cdf7da6e69e4d521f3fe06999cf89bc796c7617dab84ed3d3c4"}
Sep 10 00:05:24.291275 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:24.291233    2560 patch_prober.go:28] interesting pod/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 00:05:24.291686 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:24.291291    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 00:05:24.929362 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:24.929321    2560 generic.go:356] "Generic (PLEG): container finished" podID="c37355e8-c3b8-4256-97ff-669bf7822645" containerID="062a590d32084ff3bed01f2f71dfeb38f948e8240b1e953452a9192b16a3df41" exitCode=0
Sep 10 00:05:24.929545 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:24.929420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2" event={"ID":"c37355e8-c3b8-4256-97ff-669bf7822645","Type":"ContainerDied","Data":"062a590d32084ff3bed01f2f71dfeb38f948e8240b1e953452a9192b16a3df41"}
Sep 10 00:05:25.292084 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:25.292045    2560 patch_prober.go:28] interesting pod/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 00:05:25.292502 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:25.292125    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 00:05:26.127470 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:26.127444    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"
Sep 10 00:05:26.165956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:26.165697    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c37355e8-c3b8-4256-97ff-669bf7822645-maas-api-service-ca\") pod \"c37355e8-c3b8-4256-97ff-669bf7822645\" (UID: \"c37355e8-c3b8-4256-97ff-669bf7822645\") "
Sep 10 00:05:26.170954 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:26.166549    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c37355e8-c3b8-4256-97ff-669bf7822645-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c37355e8-c3b8-4256-97ff-669bf7822645" (UID: "c37355e8-c3b8-4256-97ff-669bf7822645"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:05:26.270010 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:26.266753    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c37355e8-c3b8-4256-97ff-669bf7822645-maas-api-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:26.291429 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:26.291389    2560 patch_prober.go:28] interesting pod/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 00:05:26.291618 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:26.291445    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 00:05:26.514123 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:26.514090    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:05:26.942984 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:26.942920    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"
Sep 10 00:05:26.942984 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:26.942963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2" event={"ID":"c37355e8-c3b8-4256-97ff-669bf7822645","Type":"ContainerDied","Data":"a2ecb616e3455cdf7da6e69e4d521f3fe06999cf89bc796c7617dab84ed3d3c4"}
Sep 10 00:05:26.943191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:26.943029    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2ecb616e3455cdf7da6e69e4d521f3fe06999cf89bc796c7617dab84ed3d3c4"
Sep 10 00:05:27.296163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:27.296079    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:05:27.296512 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:27.296488    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:05:27.297071 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:27.297056    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:05:28.991031 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:28.990994    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:29.056304 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:29.056267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:29.175579 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:29.175536    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"]
Sep 10 00:05:29.177540 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:29.177515    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e214cef3-2jjl2"]
Sep 10 00:05:29.320006 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:29.319953    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"]
Sep 10 00:05:29.514560 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:29.514525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:29.961903 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:29.961857    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy" containerID="cri-o://6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964" gracePeriod=30
Sep 10 00:05:30.009585 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.009551    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"]
Sep 10 00:05:30.010210 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.010189    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c37355e8-c3b8-4256-97ff-669bf7822645" containerName="revoke-keys"
Sep 10 00:05:30.010307 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.010212    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c37355e8-c3b8-4256-97ff-669bf7822645" containerName="revoke-keys"
Sep 10 00:05:30.010307 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.010240    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy"
Sep 10 00:05:30.010307 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.010249    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ebc282f-52c0-4005-9c28-3ac92e4ee036" containerName="istio-proxy"
Sep 10 00:05:30.010456 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.010349    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c37355e8-c3b8-4256-97ff-669bf7822645" containerName="revoke-keys"
Sep 10 00:05:30.012480 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.012458    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.014824 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.014800    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a2f357ac-openshift-default-dockercfg-8bxxr\""
Sep 10 00:05:30.023428 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.023401    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"]
Sep 10 00:05:30.112466 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.112424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istiod-ca-cert\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.112644 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.112580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-certs\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.112644 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.112634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-credential-socket\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.112776 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.112712    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-socket\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.112776 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.112756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxdn\" (UniqueName: \"kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-kube-api-access-lxxdn\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.112878 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.112855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-envoy\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.112921 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.112895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-data\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.112987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.112920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-podinfo\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.112987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.112954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-token\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.213975 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.213853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-socket\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.213975 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.213922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxdn\" (UniqueName: \"kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-kube-api-access-lxxdn\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.214231 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.213999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-envoy\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.214231 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.214033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-data\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.214231 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.214064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-podinfo\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.214231 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.214086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-token\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.214231 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.214117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istiod-ca-cert\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.214231 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.214214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-certs\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.214542 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.214259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-credential-socket\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.214765 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.214719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-credential-socket\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.215010 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.214987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-socket\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.216123 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.216086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-data\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.219204 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.217101    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istiod-ca-cert\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.219204 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.217357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-certs\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.219204 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.219092    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-podinfo\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.226949 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.223908    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-envoy\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.227712 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.227681    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxdn\" (UniqueName: \"kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-kube-api-access-lxxdn\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.230950 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.229207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-token\") pod \"e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") " pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.325908 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.325862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:30.342639 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.342598    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c37355e8-c3b8-4256-97ff-669bf7822645" path="/var/lib/kubelet/pods/c37355e8-c3b8-4256-97ff-669bf7822645/volumes"
Sep 10 00:05:30.500613 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.500528    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:30.562501 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.562463    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:30.602564 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.602542    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"]
Sep 10 00:05:30.604387 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:05:30.604359    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e7efc0_dcac_4fca_8144_d169dbcda0d5.slice/crio-586146509c81d35a69eccde32faf390b1818adda1b1f7d94cf533ef2e3ee7bfe WatchSource:0}: Error finding container 586146509c81d35a69eccde32faf390b1818adda1b1f7d94cf533ef2e3ee7bfe: Status 404 returned error can't find the container with id 586146509c81d35a69eccde32faf390b1818adda1b1f7d94cf533ef2e3ee7bfe
Sep 10 00:05:30.606672 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.606641    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:05:30.606787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.606702    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:05:30.606787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.606730    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:05:30.968885 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.968851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" event={"ID":"a4e7efc0-dcac-4fca-8144-d169dbcda0d5","Type":"ContainerStarted","Data":"528d233834debe53ef56d8b42a6aa9bead53cb0aa6889fe6d69a4986e629316f"}
Sep 10 00:05:30.969087 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.968905    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" event={"ID":"a4e7efc0-dcac-4fca-8144-d169dbcda0d5","Type":"ContainerStarted","Data":"586146509c81d35a69eccde32faf390b1818adda1b1f7d94cf533ef2e3ee7bfe"}
Sep 10 00:05:30.988732 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:30.988677    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" podStartSLOduration=1.9886615829999998 podStartE2EDuration="1.988661583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:05:30.987206626 +0000 UTC m=+1005.119333856" watchObservedRunningTime="2026-09-10 00:05:30.988661583 +0000 UTC m=+1005.120788811"
Sep 10 00:05:31.326992 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:31.326953    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:31.332598 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:31.332571    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:31.975444 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:31.975412    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:31.976486 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:31.976463    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:32.316099 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:32.316064    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:32.414659 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:32.414628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:33.513450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:33.513420    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:33.613806 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:33.613774    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:33.714152 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:33.714117    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:34.707709 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:34.707637    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:34.797733 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:34.797699    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:35.212846 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.212820    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:05:35.269310 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269233    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2kh9\" (UniqueName: \"kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-kube-api-access-z2kh9\") pod \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") "
Sep 10 00:05:35.269310 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-socket\") pod \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") "
Sep 10 00:05:35.269513 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269331    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-certs\") pod \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") "
Sep 10 00:05:35.269513 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269379    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-envoy\") pod \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") "
Sep 10 00:05:35.269513 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269416    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-data\") pod \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") "
Sep 10 00:05:35.269513 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269433    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-token\") pod \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") "
Sep 10 00:05:35.269513 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269477    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istiod-ca-cert\") pod \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") "
Sep 10 00:05:35.269513 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269512    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-credential-socket\") pod \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") "
Sep 10 00:05:35.269832 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-podinfo\") pod \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\" (UID: \"8209e1c4-cba3-4b08-b651-bc2bfcb950e2\") "
Sep 10 00:05:35.269832 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269684    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8209e1c4-cba3-4b08-b651-bc2bfcb950e2" (UID: "8209e1c4-cba3-4b08-b651-bc2bfcb950e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:05:35.269832 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269798    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8209e1c4-cba3-4b08-b651-bc2bfcb950e2" (UID: "8209e1c4-cba3-4b08-b651-bc2bfcb950e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:05:35.269832 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269813    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8209e1c4-cba3-4b08-b651-bc2bfcb950e2" (UID: "8209e1c4-cba3-4b08-b651-bc2bfcb950e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:05:35.270072 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269827    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "8209e1c4-cba3-4b08-b651-bc2bfcb950e2" (UID: "8209e1c4-cba3-4b08-b651-bc2bfcb950e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:05:35.270072 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269902    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:35.270072 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269921    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:35.270072 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.269998    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:35.270072 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.270014    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:35.270331 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.270145    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8209e1c4-cba3-4b08-b651-bc2bfcb950e2" (UID: "8209e1c4-cba3-4b08-b651-bc2bfcb950e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:05:35.271501 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.271465    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-kube-api-access-z2kh9" (OuterVolumeSpecName: "kube-api-access-z2kh9") pod "8209e1c4-cba3-4b08-b651-bc2bfcb950e2" (UID: "8209e1c4-cba3-4b08-b651-bc2bfcb950e2"). InnerVolumeSpecName "kube-api-access-z2kh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:05:35.271659 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.271638    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8209e1c4-cba3-4b08-b651-bc2bfcb950e2" (UID: "8209e1c4-cba3-4b08-b651-bc2bfcb950e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:05:35.271744 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.271728    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8209e1c4-cba3-4b08-b651-bc2bfcb950e2" (UID: "8209e1c4-cba3-4b08-b651-bc2bfcb950e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:05:35.271841 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.271819    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "8209e1c4-cba3-4b08-b651-bc2bfcb950e2" (UID: "8209e1c4-cba3-4b08-b651-bc2bfcb950e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:05:35.370755 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.370718    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:35.370755 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.370748    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:35.370755 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.370757    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:35.370755 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.370765    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:35.371068 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.370774    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2kh9\" (UniqueName: \"kubernetes.io/projected/8209e1c4-cba3-4b08-b651-bc2bfcb950e2-kube-api-access-z2kh9\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:05:35.538808 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:35.538726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:36.000135 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.000095    2560 generic.go:356] "Generic (PLEG): container finished" podID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerID="6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964" exitCode=0
Sep 10 00:05:36.000603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.000147    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"
Sep 10 00:05:36.000603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.000176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" event={"ID":"8209e1c4-cba3-4b08-b651-bc2bfcb950e2","Type":"ContainerDied","Data":"6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964"}
Sep 10 00:05:36.000603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.000244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv" event={"ID":"8209e1c4-cba3-4b08-b651-bc2bfcb950e2","Type":"ContainerDied","Data":"57fc8c55f0e3358194ea8fd7fa5b132b97af497f96191c69ef2cdbaa227bf6b9"}
Sep 10 00:05:36.000603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.000279    2560 scope.go:117] "RemoveContainer" containerID="6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964"
Sep 10 00:05:36.010569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.010550    2560 scope.go:117] "RemoveContainer" containerID="1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523"
Sep 10 00:05:36.019702 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.019676    2560 scope.go:117] "RemoveContainer" containerID="6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964"
Sep 10 00:05:36.020260 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:05:36.020072    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964\": container with ID starting with 6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964 not found: ID does not exist" containerID="6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964"
Sep 10 00:05:36.020260 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.020119    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964"} err="failed to get container status \"6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964\": rpc error: code = NotFound desc = could not find container \"6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964\": container with ID starting with 6bcc48ec2c1f1087fee7eb8795aba4e9018ad6d1c054ad347170fd3c43e71964 not found: ID does not exist"
Sep 10 00:05:36.020260 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.020142    2560 scope.go:117] "RemoveContainer" containerID="1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523"
Sep 10 00:05:36.020515 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:05:36.020486    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523\": container with ID starting with 1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523 not found: ID does not exist" containerID="1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523"
Sep 10 00:05:36.020583 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.020522    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523"} err="failed to get container status \"1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523\": rpc error: code = NotFound desc = could not find container \"1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523\": container with ID starting with 1faf2b5664d175d64e40b7597a9dde72989406f3e856ed2ed0a25cbe19b3f523 not found: ID does not exist"
Sep 10 00:05:36.022630 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.022608    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"]
Sep 10 00:05:36.026147 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.026125    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv"]
Sep 10 00:05:36.343484 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:36.343449    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" path="/var/lib/kubelet/pods/8209e1c4-cba3-4b08-b651-bc2bfcb950e2/volumes"
Sep 10 00:05:43.374782 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:43.374741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:43.475618 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:43.475583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:44.711868 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:44.711826    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:05:52.556926 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:52.556891    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:05:56.121164 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:56.121130    2560 generic.go:356] "Generic (PLEG): container finished" podID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerID="528d233834debe53ef56d8b42a6aa9bead53cb0aa6889fe6d69a4986e629316f" exitCode=0
Sep 10 00:05:56.121606 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:56.121200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" event={"ID":"a4e7efc0-dcac-4fca-8144-d169dbcda0d5","Type":"ContainerDied","Data":"528d233834debe53ef56d8b42a6aa9bead53cb0aa6889fe6d69a4986e629316f"}
Sep 10 00:05:56.121606 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:56.121586    2560 scope.go:117] "RemoveContainer" containerID="528d233834debe53ef56d8b42a6aa9bead53cb0aa6889fe6d69a4986e629316f"
Sep 10 00:05:56.122830 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:56.122794    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:05:56.122892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:56.122860    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:05:56.122892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:56.122888    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:05:57.128622 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:57.128580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" event={"ID":"a4e7efc0-dcac-4fca-8144-d169dbcda0d5","Type":"ContainerStarted","Data":"5b9afa0d61dba1945a120f409ac3c77ccdeb2df4229a56de8f242a80bfffb763"}
Sep 10 00:05:57.326424 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:57.326378    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:05:57.327384 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:57.327357    2560 patch_prober.go:28] interesting pod/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 00:05:57.327508 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:57.327408    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 00:05:58.326890 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:58.326847    2560 patch_prober.go:28] interesting pod/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 00:05:58.327328 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:58.326910    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 00:05:59.326265 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:59.326231    2560 patch_prober.go:28] interesting pod/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 00:05:59.326443 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:05:59.326285    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 00:06:00.327010 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:00.326977    2560 patch_prober.go:28] interesting pod/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 00:06:00.327405 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:00.327040    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 00:06:01.326299 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:01.326249    2560 patch_prober.go:28] interesting pod/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 00:06:01.326471 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:01.326321    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 00:06:01.975398 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:01.975356    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:06:02.330635 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:02.330601    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:06:02.331656 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:02.331637    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:06:05.206150 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:05.206118    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:06:08.008906 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.008858    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"]
Sep 10 00:06:08.009322 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.009300    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy"
Sep 10 00:06:08.009322 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.009312    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy"
Sep 10 00:06:08.009398 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.009381    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy"
Sep 10 00:06:08.011297 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.011280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"
Sep 10 00:06:08.013639 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.013613    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 00:06:08.013778 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.013660    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxc4l\""
Sep 10 00:06:08.018890 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.018861    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"]
Sep 10 00:06:08.107192 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.107152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf\" (UID: \"fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"
Sep 10 00:06:08.207960 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.207895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf\" (UID: \"fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"
Sep 10 00:06:08.208528 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.208506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf\" (UID: \"fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"
Sep 10 00:06:08.324169 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.324127    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"
Sep 10 00:06:08.595443 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:08.595412    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"]
Sep 10 00:06:08.598291 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:06:08.598264    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd2dc1d8_abe2_40db_b68f_7e605eb8d7d0.slice/crio-cc88bb79a95b593188b1c2deb394ecdaf62ee263da3a9d76fd0c0229c33a2359 WatchSource:0}: Error finding container cc88bb79a95b593188b1c2deb394ecdaf62ee263da3a9d76fd0c0229c33a2359: Status 404 returned error can't find the container with id cc88bb79a95b593188b1c2deb394ecdaf62ee263da3a9d76fd0c0229c33a2359
Sep 10 00:06:09.196474 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:09.196370    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf" event={"ID":"fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0","Type":"ContainerStarted","Data":"6855305f3d40b8b476decb31e9fe35e3e65a42bc34782d9cdf9b29f42ae86a21"}
Sep 10 00:06:09.196474 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:09.196433    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf" event={"ID":"fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0","Type":"ContainerStarted","Data":"cc88bb79a95b593188b1c2deb394ecdaf62ee263da3a9d76fd0c0229c33a2359"}
Sep 10 00:06:09.210276 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:09.210137    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf" podStartSLOduration=2.2101202 podStartE2EDuration="2.2101202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:06:09.209983714 +0000 UTC m=+1043.342110945" watchObservedRunningTime="2026-09-10 00:06:09.2101202 +0000 UTC m=+1043.342247429"
Sep 10 00:06:09.396314 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:06:09.396284    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd2dc1d8_abe2_40db_b68f_7e605eb8d7d0.slice/crio-conmon-6855305f3d40b8b476decb31e9fe35e3e65a42bc34782d9cdf9b29f42ae86a21.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 00:06:09.640486 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:09.640441    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:10.203594 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:10.203558    2560 generic.go:356] "Generic (PLEG): container finished" podID="fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0" containerID="6855305f3d40b8b476decb31e9fe35e3e65a42bc34782d9cdf9b29f42ae86a21" exitCode=0
Sep 10 00:06:10.204016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:10.203644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf" event={"ID":"fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0","Type":"ContainerDied","Data":"6855305f3d40b8b476decb31e9fe35e3e65a42bc34782d9cdf9b29f42ae86a21"}
Sep 10 00:06:11.348498 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:11.348472    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"
Sep 10 00:06:11.440518 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:11.440477    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0-maas-api-service-ca\") pod \"fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0\" (UID: \"fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0\") "
Sep 10 00:06:11.440859 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:11.440832    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0" (UID: "fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:06:11.541716 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:11.541645    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0-maas-api-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:06:12.214869 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:12.214833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf" event={"ID":"fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0","Type":"ContainerDied","Data":"cc88bb79a95b593188b1c2deb394ecdaf62ee263da3a9d76fd0c0229c33a2359"}
Sep 10 00:06:12.215059 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:12.214887    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc88bb79a95b593188b1c2deb394ecdaf62ee263da3a9d76fd0c0229c33a2359"
Sep 10 00:06:12.215059 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:12.214851    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"
Sep 10 00:06:13.958920 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:13.958886    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:18.252491 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:18.252453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:18.816189 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:18.816160    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:18.882187 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:18.882155    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:18.982490 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:18.982453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:19.002066 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:19.002034    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"]
Sep 10 00:06:19.004907 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:19.004884    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2f357ac-4nxcf"]
Sep 10 00:06:19.055266 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:19.055244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:19.659805 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:19.659770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:20.087306 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:20.087271    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"]
Sep 10 00:06:20.087598 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:20.087560    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy" containerID="cri-o://5b9afa0d61dba1945a120f409ac3c77ccdeb2df4229a56de8f242a80bfffb763" gracePeriod=30
Sep 10 00:06:20.108874 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:20.108848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:20.330318 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:20.330281    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:20.340657 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:20.340583    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0" path="/var/lib/kubelet/pods/fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0/volumes"
Sep 10 00:06:20.496498 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:20.496470    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:20.551927 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:20.551891    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:20.860462 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:20.860423    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:24.791740 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:24.791704    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:06:25.289743 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.289711    2560 generic.go:356] "Generic (PLEG): container finished" podID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerID="5b9afa0d61dba1945a120f409ac3c77ccdeb2df4229a56de8f242a80bfffb763" exitCode=0
Sep 10 00:06:25.289897 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.289747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" event={"ID":"a4e7efc0-dcac-4fca-8144-d169dbcda0d5","Type":"ContainerDied","Data":"5b9afa0d61dba1945a120f409ac3c77ccdeb2df4229a56de8f242a80bfffb763"}
Sep 10 00:06:25.289897 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.289828    2560 scope.go:117] "RemoveContainer" containerID="528d233834debe53ef56d8b42a6aa9bead53cb0aa6889fe6d69a4986e629316f"
Sep 10 00:06:25.362216 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.362147    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:06:25.481910 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.481864    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-podinfo\") pod \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") "
Sep 10 00:06:25.482106 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.481992    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxxdn\" (UniqueName: \"kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-kube-api-access-lxxdn\") pod \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") "
Sep 10 00:06:25.482106 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482013    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istiod-ca-cert\") pod \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") "
Sep 10 00:06:25.482106 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482032    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-certs\") pod \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") "
Sep 10 00:06:25.482106 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482075    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-socket\") pod \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") "
Sep 10 00:06:25.482291 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482120    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-envoy\") pod \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") "
Sep 10 00:06:25.482291 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482153    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-credential-socket\") pod \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") "
Sep 10 00:06:25.482291 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482178    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-data\") pod \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") "
Sep 10 00:06:25.482291 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482230    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-token\") pod \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\" (UID: \"a4e7efc0-dcac-4fca-8144-d169dbcda0d5\") "
Sep 10 00:06:25.482490 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482424    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a4e7efc0-dcac-4fca-8144-d169dbcda0d5" (UID: "a4e7efc0-dcac-4fca-8144-d169dbcda0d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:06:25.482613 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482574    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a4e7efc0-dcac-4fca-8144-d169dbcda0d5" (UID: "a4e7efc0-dcac-4fca-8144-d169dbcda0d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:06:25.482613 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482588    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a4e7efc0-dcac-4fca-8144-d169dbcda0d5" (UID: "a4e7efc0-dcac-4fca-8144-d169dbcda0d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:06:25.482613 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482611    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:06:25.482861 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482492    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a4e7efc0-dcac-4fca-8144-d169dbcda0d5" (UID: "a4e7efc0-dcac-4fca-8144-d169dbcda0d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:06:25.482861 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.482729    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "a4e7efc0-dcac-4fca-8144-d169dbcda0d5" (UID: "a4e7efc0-dcac-4fca-8144-d169dbcda0d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:06:25.484180 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.484160    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-kube-api-access-lxxdn" (OuterVolumeSpecName: "kube-api-access-lxxdn") pod "a4e7efc0-dcac-4fca-8144-d169dbcda0d5" (UID: "a4e7efc0-dcac-4fca-8144-d169dbcda0d5"). InnerVolumeSpecName "kube-api-access-lxxdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:06:25.484543 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.484523    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "a4e7efc0-dcac-4fca-8144-d169dbcda0d5" (UID: "a4e7efc0-dcac-4fca-8144-d169dbcda0d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:06:25.484746 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.484725    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a4e7efc0-dcac-4fca-8144-d169dbcda0d5" (UID: "a4e7efc0-dcac-4fca-8144-d169dbcda0d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:06:25.484795 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.484729    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a4e7efc0-dcac-4fca-8144-d169dbcda0d5" (UID: "a4e7efc0-dcac-4fca-8144-d169dbcda0d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:06:25.584190 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.584145    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:06:25.584190 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.584183    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:06:25.584190 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.584192    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:06:25.584190 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.584201    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:06:25.584450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.584220    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:06:25.584450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.584229    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:06:25.584450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.584236    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:06:25.584450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.584245    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxxdn\" (UniqueName: \"kubernetes.io/projected/a4e7efc0-dcac-4fca-8144-d169dbcda0d5-kube-api-access-lxxdn\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:06:25.940949 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:25.940903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:26.296853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:26.296763    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr" event={"ID":"a4e7efc0-dcac-4fca-8144-d169dbcda0d5","Type":"ContainerDied","Data":"586146509c81d35a69eccde32faf390b1818adda1b1f7d94cf533ef2e3ee7bfe"}
Sep 10 00:06:26.296853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:26.296786    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"
Sep 10 00:06:26.296853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:26.296850    2560 scope.go:117] "RemoveContainer" containerID="5b9afa0d61dba1945a120f409ac3c77ccdeb2df4229a56de8f242a80bfffb763"
Sep 10 00:06:26.318243 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:26.318219    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"]
Sep 10 00:06:26.320251 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:26.320227    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr"]
Sep 10 00:06:26.340268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:26.340234    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" path="/var/lib/kubelet/pods/a4e7efc0-dcac-4fca-8144-d169dbcda0d5/volumes"
Sep 10 00:06:30.301845 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.301795    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:30.771633 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.771548    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"]
Sep 10 00:06:30.772005 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.771980    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0" containerName="revoke-keys"
Sep 10 00:06:30.772005 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.771997    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0" containerName="revoke-keys"
Sep 10 00:06:30.772005 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.772011    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy"
Sep 10 00:06:30.772285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.772019    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy"
Sep 10 00:06:30.772285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.772058    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy"
Sep 10 00:06:30.772285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.772068    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy"
Sep 10 00:06:30.772285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.772179    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy"
Sep 10 00:06:30.772285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.772194    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy"
Sep 10 00:06:30.772285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.772204    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8209e1c4-cba3-4b08-b651-bc2bfcb950e2" containerName="istio-proxy"
Sep 10 00:06:30.772285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.772216    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd2dc1d8-abe2-40db-b68f-7e605eb8d7d0" containerName="revoke-keys"
Sep 10 00:06:30.777044 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.777021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.779663 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.779602    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-96c64491-openshift-default-dockercfg-6pq6k\""
Sep 10 00:06:30.783775 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.783753    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"]
Sep 10 00:06:30.790742 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.790718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:30.835744 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.835712    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-data\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.835884 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.835752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-certs\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.835884 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.835810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-credential-socket\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.835884 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.835868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-socket\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.836047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.835917    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-token\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.836047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.835959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-podinfo\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.836047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.836000    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-envoy\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.836047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.836023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istiod-ca-cert\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.836188 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.836087    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxqw5\" (UniqueName: \"kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-kube-api-access-zxqw5\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.936781 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.936744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-envoy\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.936781 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.936791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istiod-ca-cert\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937065 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.936825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxqw5\" (UniqueName: \"kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-kube-api-access-zxqw5\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937065 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.936845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-data\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937065 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.936867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-certs\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937065 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.937020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-credential-socket\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937259 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.937102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-socket\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937259 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.937189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-token\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937259 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.937223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-podinfo\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937422 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.937395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-certs\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937475 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.937434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-data\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937577 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.937474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-credential-socket\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937577 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.937553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-socket\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.937678 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.937658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istiod-ca-cert\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.939329 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.939307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-envoy\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.939550 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.939532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-podinfo\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.944976 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.944951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-token\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.945521 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.945504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxqw5\" (UniqueName: \"kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-kube-api-access-zxqw5\") pod \"e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") " pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:30.990906 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:30.990875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:31.089399 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:31.089372    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:31.366388 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:31.366364    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"]
Sep 10 00:06:31.368595 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:06:31.368564    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6cdb70_505c_4d35_9dc8_17113f9105c9.slice/crio-9a2bdc23cbb9918a3f56878eca2cba19bf69e7974e1176a041bde6ba4b42489e WatchSource:0}: Error finding container 9a2bdc23cbb9918a3f56878eca2cba19bf69e7974e1176a041bde6ba4b42489e: Status 404 returned error can't find the container with id 9a2bdc23cbb9918a3f56878eca2cba19bf69e7974e1176a041bde6ba4b42489e
Sep 10 00:06:31.371107 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:31.371067    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:06:31.371193 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:31.371154    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:06:31.371232 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:31.371195    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:06:32.332438 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:32.332403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" event={"ID":"ff6cdb70-505c-4d35-9dc8-17113f9105c9","Type":"ContainerStarted","Data":"e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e"}
Sep 10 00:06:32.332641 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:32.332453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" event={"ID":"ff6cdb70-505c-4d35-9dc8-17113f9105c9","Type":"ContainerStarted","Data":"9a2bdc23cbb9918a3f56878eca2cba19bf69e7974e1176a041bde6ba4b42489e"}
Sep 10 00:06:32.353296 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:32.353248    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" podStartSLOduration=2.353232774 podStartE2EDuration="2.353232774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:06:32.351895837 +0000 UTC m=+1066.484023065" watchObservedRunningTime="2026-09-10 00:06:32.353232774 +0000 UTC m=+1066.485360002"
Sep 10 00:06:33.089847 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:33.089806    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:33.095127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:33.095104    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:33.338676 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:33.338645    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:33.339487 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:33.339465    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:33.689151 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:33.689105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:33.779756 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:33.779726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:34.935502 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:34.935471    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:35.036513 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:35.036477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:35.383082 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:35.383051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:35.481705 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:35.481672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:35.573585 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:35.573553    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:45.339530 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:45.339456    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:46.098557 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:46.098522    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:06:56.463134 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:56.463098    2560 generic.go:356] "Generic (PLEG): container finished" podID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerID="e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e" exitCode=0
Sep 10 00:06:56.463621 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:56.463178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" event={"ID":"ff6cdb70-505c-4d35-9dc8-17113f9105c9","Type":"ContainerDied","Data":"e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e"}
Sep 10 00:06:56.463621 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:56.463602    2560 scope.go:117] "RemoveContainer" containerID="e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e"
Sep 10 00:06:56.464829 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:56.464797    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:06:56.464922 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:56.464898    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:06:56.464992 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:56.464960    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:06:56.622658 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:56.622624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:06:57.473809 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:57.473755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" event={"ID":"ff6cdb70-505c-4d35-9dc8-17113f9105c9","Type":"ContainerStarted","Data":"32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0"}
Sep 10 00:06:58.089680 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.089642    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:06:58.089886 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.089861    2560 patch_prober.go:28] interesting pod/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 00:06:58.089966 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.089922    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 00:06:58.267234 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.267201    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"]
Sep 10 00:06:58.268266 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.268235    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy"
Sep 10 00:06:58.268429 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.268416    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e7efc0-dcac-4fca-8144-d169dbcda0d5" containerName="istio-proxy"
Sep 10 00:06:58.272422 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.272398    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"
Sep 10 00:06:58.275255 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.275045    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxc4l\""
Sep 10 00:06:58.275255 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.275122    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 00:06:58.278979 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.278960    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"]
Sep 10 00:06:58.405630 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.405541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e43990-e1a1-43a5-bd2d-741774c242b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-96c64491-lx6zn\" (UID: \"e9e43990-e1a1-43a5-bd2d-741774c242b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"
Sep 10 00:06:58.506733 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.506703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e43990-e1a1-43a5-bd2d-741774c242b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-96c64491-lx6zn\" (UID: \"e9e43990-e1a1-43a5-bd2d-741774c242b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"
Sep 10 00:06:58.507307 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.507286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e43990-e1a1-43a5-bd2d-741774c242b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-96c64491-lx6zn\" (UID: \"e9e43990-e1a1-43a5-bd2d-741774c242b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"
Sep 10 00:06:58.585755 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.585716    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"
Sep 10 00:06:58.855307 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:58.855248    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"]
Sep 10 00:06:59.090613 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:59.090576    2560 patch_prober.go:28] interesting pod/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 00:06:59.090763 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:59.090630    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 00:06:59.485730 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:59.485695    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn" event={"ID":"e9e43990-e1a1-43a5-bd2d-741774c242b2","Type":"ContainerStarted","Data":"04da50ff3bab36638f18e1e613cf9e8336054c135dd200bf970bebd962fb9f4c"}
Sep 10 00:06:59.485905 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:59.485743    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn" event={"ID":"e9e43990-e1a1-43a5-bd2d-741774c242b2","Type":"ContainerStarted","Data":"2ccce18f9d9a942539d0d33ee6a470a705ba2a18fa1975d9fae974c7fc84f992"}
Sep 10 00:06:59.500320 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:06:59.500269    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn" podStartSLOduration=1.500252883 podStartE2EDuration="1.500252883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:06:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:06:59.499496895 +0000 UTC m=+1093.631624123" watchObservedRunningTime="2026-09-10 00:06:59.500252883 +0000 UTC m=+1093.632380127"
Sep 10 00:07:00.090194 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:00.090151    2560 patch_prober.go:28] interesting pod/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 00:07:00.090609 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:00.090215    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 00:07:00.492743 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:00.492708    2560 generic.go:356] "Generic (PLEG): container finished" podID="e9e43990-e1a1-43a5-bd2d-741774c242b2" containerID="04da50ff3bab36638f18e1e613cf9e8336054c135dd200bf970bebd962fb9f4c" exitCode=0
Sep 10 00:07:00.492949 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:00.492796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn" event={"ID":"e9e43990-e1a1-43a5-bd2d-741774c242b2","Type":"ContainerDied","Data":"04da50ff3bab36638f18e1e613cf9e8336054c135dd200bf970bebd962fb9f4c"}
Sep 10 00:07:01.090530 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:01.090490    2560 patch_prober.go:28] interesting pod/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 00:07:01.091040 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:01.090553    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 00:07:01.680803 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:01.680774    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"
Sep 10 00:07:01.842369 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:01.842339    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e43990-e1a1-43a5-bd2d-741774c242b2-maas-api-service-ca\") pod \"e9e43990-e1a1-43a5-bd2d-741774c242b2\" (UID: \"e9e43990-e1a1-43a5-bd2d-741774c242b2\") "
Sep 10 00:07:01.842678 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:01.842653    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9e43990-e1a1-43a5-bd2d-741774c242b2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9e43990-e1a1-43a5-bd2d-741774c242b2" (UID: "e9e43990-e1a1-43a5-bd2d-741774c242b2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:07:01.943312 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:01.943278    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e43990-e1a1-43a5-bd2d-741774c242b2-maas-api-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:02.090339 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:02.090301    2560 patch_prober.go:28] interesting pod/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 00:07:02.090549 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:02.090373    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 00:07:02.505279 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:02.505243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn" event={"ID":"e9e43990-e1a1-43a5-bd2d-741774c242b2","Type":"ContainerDied","Data":"2ccce18f9d9a942539d0d33ee6a470a705ba2a18fa1975d9fae974c7fc84f992"}
Sep 10 00:07:02.505279 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:02.505267    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"
Sep 10 00:07:02.505482 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:02.505296    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ccce18f9d9a942539d0d33ee6a470a705ba2a18fa1975d9fae974c7fc84f992"
Sep 10 00:07:02.514741 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:02.514708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:02.727951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:02.727851    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"]
Sep 10 00:07:02.728155 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:02.728126    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy" containerID="cri-o://b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3" gracePeriod=30
Sep 10 00:07:02.750566 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:02.750539    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:03.093862 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.093827    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:07:03.094317 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.094270    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:07:03.094869 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.094849    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:07:03.170333 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.170305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:03.448813 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.448729    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"]
Sep 10 00:07:03.449313 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.449287    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e43990-e1a1-43a5-bd2d-741774c242b2" containerName="revoke-keys"
Sep 10 00:07:03.449313 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.449313    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e43990-e1a1-43a5-bd2d-741774c242b2" containerName="revoke-keys"
Sep 10 00:07:03.449549 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.449396    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9e43990-e1a1-43a5-bd2d-741774c242b2" containerName="revoke-keys"
Sep 10 00:07:03.452892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.452867    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.455362 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.455340    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-8376bc-openshift-default-dockercfg-nl7tm\""
Sep 10 00:07:03.463483 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.463460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"]
Sep 10 00:07:03.471719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.471696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:03.558704 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.558662    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-envoy\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.558889 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.558721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-data\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.558889 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.558782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-podinfo\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.558889 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.558821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a16f66c6-685e-43e6-9891-7e18f9ec1904-istiod-ca-cert\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.558889 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.558857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-credential-socket\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.559113 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.558906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-certs\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.559113 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.558952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-token\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.559113 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.558995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-socket\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.559113 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.559048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rn46\" (UniqueName: \"kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-kube-api-access-2rn46\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.571013 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.570988    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:03.660636 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.660592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-data\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.660833 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.660658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-podinfo\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.660833 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.660696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a16f66c6-685e-43e6-9891-7e18f9ec1904-istiod-ca-cert\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.660833 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.660735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-credential-socket\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.660833 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.660794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-certs\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.660833 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.660825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-token\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.661158 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.660890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-socket\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.661158 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.661014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rn46\" (UniqueName: \"kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-kube-api-access-2rn46\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.661158 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.661097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-envoy\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.661319 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.661264    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-data\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.661779 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.661608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-credential-socket\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.661779 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.661678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-certs\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.662030 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.661920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-socket\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.662030 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.661992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a16f66c6-685e-43e6-9891-7e18f9ec1904-istiod-ca-cert\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.663433 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.663403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-envoy\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.663769 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.663751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-podinfo\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.669012 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.668992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rn46\" (UniqueName: \"kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-kube-api-access-2rn46\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.669098 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.669034    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-token\") pod \"e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") " pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:03.765548 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:03.765479    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:04.039379 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:04.039345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"]
Sep 10 00:07:04.040361 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:07:04.040333    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16f66c6_685e_43e6_9891_7e18f9ec1904.slice/crio-1f0d33888679368a6a11e145a56e1c9a2fdd3196d4060cfe99beecd37d92526b WatchSource:0}: Error finding container 1f0d33888679368a6a11e145a56e1c9a2fdd3196d4060cfe99beecd37d92526b: Status 404 returned error can't find the container with id 1f0d33888679368a6a11e145a56e1c9a2fdd3196d4060cfe99beecd37d92526b
Sep 10 00:07:04.042875 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:04.042838    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:07:04.042969 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:04.042951    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:07:04.043019 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:04.042998    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:07:04.519111 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:04.519072    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" event={"ID":"a16f66c6-685e-43e6-9891-7e18f9ec1904","Type":"ContainerStarted","Data":"dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d"}
Sep 10 00:07:04.519512 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:04.519167    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" event={"ID":"a16f66c6-685e-43e6-9891-7e18f9ec1904","Type":"ContainerStarted","Data":"1f0d33888679368a6a11e145a56e1c9a2fdd3196d4060cfe99beecd37d92526b"}
Sep 10 00:07:04.540225 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:04.540178    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" podStartSLOduration=1.540163365 podStartE2EDuration="1.540163365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:07:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:07:04.537472486 +0000 UTC m=+1098.669599714" watchObservedRunningTime="2026-09-10 00:07:04.540163365 +0000 UTC m=+1098.672290589"
Sep 10 00:07:04.765910 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:04.765870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:05.428110 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:05.428070    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:05.496799 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:05.496764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:05.560286 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:05.560232    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:05.614347 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:05.614313    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"]
Sep 10 00:07:05.617301 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:05.617276    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-96c64491-lx6zn"]
Sep 10 00:07:05.621522 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:05.621497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:05.734576 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:05.734495    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"]
Sep 10 00:07:05.734784 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:05.734759    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy" containerID="cri-o://32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0" gracePeriod=30
Sep 10 00:07:05.754259 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:05.754231    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:05.770853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:05.770831    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:06.340572 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:06.340541    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9e43990-e1a1-43a5-bd2d-741774c242b2" path="/var/lib/kubelet/pods/e9e43990-e1a1-43a5-bd2d-741774c242b2/volumes"
Sep 10 00:07:06.400482 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:06.400446    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:06.491771 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:06.491714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:06.531358 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:06.531330    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:06.532343 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:06.532321    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:06.569374 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:06.569342    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:07.564730 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:07.564699    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:07.663352 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:07.663314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:07.876505 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:07.876474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:07.991925 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:07.991903    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:07:08.106039 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.105945    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-certs\") pod \"5fab835e-6337-419a-b41e-659bca043d5e\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") "
Sep 10 00:07:08.106039 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106003    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-socket\") pod \"5fab835e-6337-419a-b41e-659bca043d5e\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") "
Sep 10 00:07:08.106039 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106031    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-data\") pod \"5fab835e-6337-419a-b41e-659bca043d5e\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") "
Sep 10 00:07:08.106318 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106074    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-envoy\") pod \"5fab835e-6337-419a-b41e-659bca043d5e\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") "
Sep 10 00:07:08.106318 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106107    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-credential-socket\") pod \"5fab835e-6337-419a-b41e-659bca043d5e\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") "
Sep 10 00:07:08.106318 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106190    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-istio-token\") pod \"5fab835e-6337-419a-b41e-659bca043d5e\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") "
Sep 10 00:07:08.106318 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106189    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5fab835e-6337-419a-b41e-659bca043d5e" (UID: "5fab835e-6337-419a-b41e-659bca043d5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:07:08.106318 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106258    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvls9\" (UniqueName: \"kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-kube-api-access-mvls9\") pod \"5fab835e-6337-419a-b41e-659bca043d5e\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") "
Sep 10 00:07:08.106318 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106308    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fab835e-6337-419a-b41e-659bca043d5e-istio-podinfo\") pod \"5fab835e-6337-419a-b41e-659bca043d5e\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") "
Sep 10 00:07:08.106634 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106343    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fab835e-6337-419a-b41e-659bca043d5e-istiod-ca-cert\") pod \"5fab835e-6337-419a-b41e-659bca043d5e\" (UID: \"5fab835e-6337-419a-b41e-659bca043d5e\") "
Sep 10 00:07:08.106634 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106344    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5fab835e-6337-419a-b41e-659bca043d5e" (UID: "5fab835e-6337-419a-b41e-659bca043d5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:07:08.106634 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106409    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-data" (OuterVolumeSpecName: "istio-data") pod "5fab835e-6337-419a-b41e-659bca043d5e" (UID: "5fab835e-6337-419a-b41e-659bca043d5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:07:08.106799 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106731    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:08.106799 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106750    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:08.106799 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106763    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:08.106987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.106863    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5fab835e-6337-419a-b41e-659bca043d5e" (UID: "5fab835e-6337-419a-b41e-659bca043d5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:07:08.107177 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.107105    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fab835e-6337-419a-b41e-659bca043d5e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5fab835e-6337-419a-b41e-659bca043d5e" (UID: "5fab835e-6337-419a-b41e-659bca043d5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:07:08.109410 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.109225    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5fab835e-6337-419a-b41e-659bca043d5e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5fab835e-6337-419a-b41e-659bca043d5e" (UID: "5fab835e-6337-419a-b41e-659bca043d5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:07:08.109794 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.109729    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-kube-api-access-mvls9" (OuterVolumeSpecName: "kube-api-access-mvls9") pod "5fab835e-6337-419a-b41e-659bca043d5e" (UID: "5fab835e-6337-419a-b41e-659bca043d5e"). InnerVolumeSpecName "kube-api-access-mvls9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:07:08.110031 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.110005    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-istio-token" (OuterVolumeSpecName: "istio-token") pod "5fab835e-6337-419a-b41e-659bca043d5e" (UID: "5fab835e-6337-419a-b41e-659bca043d5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:07:08.110137 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.110115    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5fab835e-6337-419a-b41e-659bca043d5e" (UID: "5fab835e-6337-419a-b41e-659bca043d5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:07:08.149844 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.149818    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:08.208231 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.208203    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvls9\" (UniqueName: \"kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-kube-api-access-mvls9\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:08.208231 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.208230    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fab835e-6337-419a-b41e-659bca043d5e-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:08.208401 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.208240    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fab835e-6337-419a-b41e-659bca043d5e-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:08.208401 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.208248    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:08.208401 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.208256    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fab835e-6337-419a-b41e-659bca043d5e-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:08.208401 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.208264    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fab835e-6337-419a-b41e-659bca043d5e-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:08.235056 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.235012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:08.546377 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.546341    2560 generic.go:356] "Generic (PLEG): container finished" podID="5fab835e-6337-419a-b41e-659bca043d5e" containerID="b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3" exitCode=0
Sep 10 00:07:08.546557 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.546421    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"
Sep 10 00:07:08.546557 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.546431    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" event={"ID":"5fab835e-6337-419a-b41e-659bca043d5e","Type":"ContainerDied","Data":"b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3"}
Sep 10 00:07:08.546557 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.546521    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr" event={"ID":"5fab835e-6337-419a-b41e-659bca043d5e","Type":"ContainerDied","Data":"15369e0a0ac3744d6dbcf5772e8f228a2e8041e0ddd45a4a23d21cd6201128bb"}
Sep 10 00:07:08.546557 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.546544    2560 scope.go:117] "RemoveContainer" containerID="b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3"
Sep 10 00:07:08.556572 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.556547    2560 scope.go:117] "RemoveContainer" containerID="3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f"
Sep 10 00:07:08.563970 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.563947    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"]
Sep 10 00:07:08.565177 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.565158    2560 scope.go:117] "RemoveContainer" containerID="b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3"
Sep 10 00:07:08.565458 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:07:08.565440    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3\": container with ID starting with b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3 not found: ID does not exist" containerID="b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3"
Sep 10 00:07:08.565516 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.565464    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3"} err="failed to get container status \"b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3\": rpc error: code = NotFound desc = could not find container \"b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3\": container with ID starting with b61476ecea88aabe9e9d647e549500de5d9b7b538061e45b15ac0dae166a85d3 not found: ID does not exist"
Sep 10 00:07:08.565516 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.565482    2560 scope.go:117] "RemoveContainer" containerID="3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f"
Sep 10 00:07:08.565760 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:07:08.565736    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f\": container with ID starting with 3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f not found: ID does not exist" containerID="3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f"
Sep 10 00:07:08.565841 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.565764    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f"} err="failed to get container status \"3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f\": rpc error: code = NotFound desc = could not find container \"3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f\": container with ID starting with 3520767f49318adbacaece6411fd58110980adf2656e85f7abf660f5cbd7805f not found: ID does not exist"
Sep 10 00:07:08.569569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:08.569548    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr"]
Sep 10 00:07:10.340830 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:10.340797    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fab835e-6337-419a-b41e-659bca043d5e" path="/var/lib/kubelet/pods/5fab835e-6337-419a-b41e-659bca043d5e/volumes"
Sep 10 00:07:10.994694 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:10.994671    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:07:11.036214 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.036134    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-data\") pod \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") "
Sep 10 00:07:11.036214 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.036176    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-socket\") pod \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") "
Sep 10 00:07:11.036214 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.036197    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-envoy\") pod \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") "
Sep 10 00:07:11.036505 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.036226    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-certs\") pod \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") "
Sep 10 00:07:11.036505 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.036249    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-token\") pod \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") "
Sep 10 00:07:11.036505 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.036430    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff6cdb70-505c-4d35-9dc8-17113f9105c9" (UID: "ff6cdb70-505c-4d35-9dc8-17113f9105c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:07:11.036662 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.036637    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxqw5\" (UniqueName: \"kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-kube-api-access-zxqw5\") pod \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") "
Sep 10 00:07:11.036761 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.036714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istiod-ca-cert\") pod \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") "
Sep 10 00:07:11.036820 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.036769    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-podinfo\") pod \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") "
Sep 10 00:07:11.036820 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.036801    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-credential-socket\") pod \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\" (UID: \"ff6cdb70-505c-4d35-9dc8-17113f9105c9\") "
Sep 10 00:07:11.037145 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.037117    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff6cdb70-505c-4d35-9dc8-17113f9105c9" (UID: "ff6cdb70-505c-4d35-9dc8-17113f9105c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:07:11.037236 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.037219    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:11.037295 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.037242    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:11.037371 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.037344    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff6cdb70-505c-4d35-9dc8-17113f9105c9" (UID: "ff6cdb70-505c-4d35-9dc8-17113f9105c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:07:11.037508 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.037485    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff6cdb70-505c-4d35-9dc8-17113f9105c9" (UID: "ff6cdb70-505c-4d35-9dc8-17113f9105c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:07:11.037625 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.037538    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff6cdb70-505c-4d35-9dc8-17113f9105c9" (UID: "ff6cdb70-505c-4d35-9dc8-17113f9105c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:07:11.039021 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.038984    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff6cdb70-505c-4d35-9dc8-17113f9105c9" (UID: "ff6cdb70-505c-4d35-9dc8-17113f9105c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:07:11.039234 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.039206    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff6cdb70-505c-4d35-9dc8-17113f9105c9" (UID: "ff6cdb70-505c-4d35-9dc8-17113f9105c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:07:11.039323 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.039243    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff6cdb70-505c-4d35-9dc8-17113f9105c9" (UID: "ff6cdb70-505c-4d35-9dc8-17113f9105c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:07:11.039489 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.039465    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-kube-api-access-zxqw5" (OuterVolumeSpecName: "kube-api-access-zxqw5") pod "ff6cdb70-505c-4d35-9dc8-17113f9105c9" (UID: "ff6cdb70-505c-4d35-9dc8-17113f9105c9"). InnerVolumeSpecName "kube-api-access-zxqw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:07:11.137959 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.137898    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:11.137959 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.137947    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:11.137959 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.137962    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:11.138200 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.137976    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:11.138200 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.137988    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff6cdb70-505c-4d35-9dc8-17113f9105c9-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:11.138200 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.137995    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:11.138200 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.138003    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxqw5\" (UniqueName: \"kubernetes.io/projected/ff6cdb70-505c-4d35-9dc8-17113f9105c9-kube-api-access-zxqw5\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:07:11.566497 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.566463    2560 generic.go:356] "Generic (PLEG): container finished" podID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerID="32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0" exitCode=0
Sep 10 00:07:11.566983 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.566519    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"
Sep 10 00:07:11.566983 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.566557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" event={"ID":"ff6cdb70-505c-4d35-9dc8-17113f9105c9","Type":"ContainerDied","Data":"32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0"}
Sep 10 00:07:11.566983 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.566615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk" event={"ID":"ff6cdb70-505c-4d35-9dc8-17113f9105c9","Type":"ContainerDied","Data":"9a2bdc23cbb9918a3f56878eca2cba19bf69e7974e1176a041bde6ba4b42489e"}
Sep 10 00:07:11.566983 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.566641    2560 scope.go:117] "RemoveContainer" containerID="32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0"
Sep 10 00:07:11.576136 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.576119    2560 scope.go:117] "RemoveContainer" containerID="e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e"
Sep 10 00:07:11.584682 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.584662    2560 scope.go:117] "RemoveContainer" containerID="32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0"
Sep 10 00:07:11.584966 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:07:11.584947    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0\": container with ID starting with 32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0 not found: ID does not exist" containerID="32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0"
Sep 10 00:07:11.585024 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.584975    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0"} err="failed to get container status \"32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0\": rpc error: code = NotFound desc = could not find container \"32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0\": container with ID starting with 32fc40f1bee28fcef15bbe849ced2dca613e7306286ee336e021407c3c1e6fc0 not found: ID does not exist"
Sep 10 00:07:11.585024 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.584991    2560 scope.go:117] "RemoveContainer" containerID="e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e"
Sep 10 00:07:11.585253 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:07:11.585235    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e\": container with ID starting with e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e not found: ID does not exist" containerID="e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e"
Sep 10 00:07:11.585306 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.585273    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e"} err="failed to get container status \"e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e\": rpc error: code = NotFound desc = could not find container \"e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e\": container with ID starting with e0358fdc468152f788b32376ab377bef01a7b2eefc4d57c96c398aa5a347565e not found: ID does not exist"
Sep 10 00:07:11.588156 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.588133    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"]
Sep 10 00:07:11.593484 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.593459    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk"]
Sep 10 00:07:11.902229 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:11.902139    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:07:12.340472 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:12.340437    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" path="/var/lib/kubelet/pods/ff6cdb70-505c-4d35-9dc8-17113f9105c9/volumes"
Sep 10 00:07:13.786292 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:13.786252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:13.841604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:13.841570    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:13.922949 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:13.922908    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:14.015985 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:14.015920    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:14.115570 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:14.115534    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:14.444008 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:14.443896    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:21.790793 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:21.790217    2560 patch_prober.go:28] interesting pod/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:57450->10.133.0.56:15021: read: connection reset by peer" start-of-body=
Sep 10 00:07:21.790793 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:21.790300    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:57450->10.133.0.56:15021: read: connection reset by peer"
Sep 10 00:07:22.634745 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:22.634708    2560 generic.go:356] "Generic (PLEG): container finished" podID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerID="dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d" exitCode=0
Sep 10 00:07:22.634969 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:22.634764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" event={"ID":"a16f66c6-685e-43e6-9891-7e18f9ec1904","Type":"ContainerDied","Data":"dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d"}
Sep 10 00:07:22.635256 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:22.635237    2560 scope.go:117] "RemoveContainer" containerID="dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d"
Sep 10 00:07:22.636373 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:22.636343    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:07:22.636471 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:22.636427    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:07:22.636535 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:22.636475    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:07:23.643001 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:23.642963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" event={"ID":"a16f66c6-685e-43e6-9891-7e18f9ec1904","Type":"ContainerStarted","Data":"8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c"}
Sep 10 00:07:23.766330 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:23.766274    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:23.766885 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:23.766851    2560 patch_prober.go:28] interesting pod/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 00:07:23.767045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:23.766954    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 00:07:24.259884 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:24.259812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:24.766170 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:24.766131    2560 patch_prober.go:28] interesting pod/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 00:07:24.766757 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:24.766721    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 00:07:25.766426 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:25.766384    2560 patch_prober.go:28] interesting pod/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 00:07:25.767093 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:25.767059    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 00:07:26.766557 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:26.766518    2560 patch_prober.go:28] interesting pod/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 00:07:26.767173 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:26.767141    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 00:07:27.766888 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:27.766837    2560 patch_prober.go:28] interesting pod/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 00:07:27.767430 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:27.766969    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 00:07:28.766114 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:28.766063    2560 patch_prober.go:28] interesting pod/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 00:07:28.766415 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:28.766381    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 00:07:29.769709 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:29.769674    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:29.770093 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:29.769960    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:29.770579 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:29.770559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:07:31.318739 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:31.318693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:33.754166 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754131    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"]
Sep 10 00:07:33.754830 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754764    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy"
Sep 10 00:07:33.754830 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754785    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy"
Sep 10 00:07:33.754830 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754811    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy"
Sep 10 00:07:33.754830 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754822    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy"
Sep 10 00:07:33.755083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754875    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy"
Sep 10 00:07:33.755083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754882    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy"
Sep 10 00:07:33.755083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754891    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy"
Sep 10 00:07:33.755083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754896    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy"
Sep 10 00:07:33.755083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754987    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy"
Sep 10 00:07:33.755083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.754997    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff6cdb70-505c-4d35-9dc8-17113f9105c9" containerName="istio-proxy"
Sep 10 00:07:33.755083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.755003    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy"
Sep 10 00:07:33.757268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.757247    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.759914 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.759893    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-cc0040\"/\"openshift-service-ca.crt\""
Sep 10 00:07:33.761011 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.760990    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-cc0040\"/\"kube-root-ca.crt\""
Sep 10 00:07:33.761126 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.761021    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-cc0040\"/\"default-dockercfg-jt2wp\""
Sep 10 00:07:33.761321 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.761302    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-cc0040\"/\"premium-w4-cc0040-kserve-self-signed-certs\""
Sep 10 00:07:33.767083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.767063    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"]
Sep 10 00:07:33.785193 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.785165    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:33.877945 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.877898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-tmp-dir\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.878100 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.877998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkbzx\" (UniqueName: \"kubernetes.io/projected/1b6f978a-dffe-46f9-8f7c-f019af76254d-kube-api-access-jkbzx\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.878100 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.878024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-dshm\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.878100 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.878058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-model-cache\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.878100 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.878083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b6f978a-dffe-46f9-8f7c-f019af76254d-tls-certs\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.878283 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.878123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-home\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.979537 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.979498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-dshm\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.979537 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.979544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-model-cache\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.979749 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.979658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b6f978a-dffe-46f9-8f7c-f019af76254d-tls-certs\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.979749 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.979715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-home\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.979850 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.979834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-tmp-dir\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.979906 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.979876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkbzx\" (UniqueName: \"kubernetes.io/projected/1b6f978a-dffe-46f9-8f7c-f019af76254d-kube-api-access-jkbzx\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.979999 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.979907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-model-cache\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.980122 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.980094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-home\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.980257 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.980232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-tmp-dir\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.981827 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.981799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-dshm\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.982100 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.982082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b6f978a-dffe-46f9-8f7c-f019af76254d-tls-certs\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:33.987667 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:33.987643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkbzx\" (UniqueName: \"kubernetes.io/projected/1b6f978a-dffe-46f9-8f7c-f019af76254d-kube-api-access-jkbzx\") pod \"premium-w4-cc0040-kserve-68b7d577d6-rtw9t\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") " pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:34.066806 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:34.066779    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:34.338084 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:07:34.338053    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b6f978a_dffe_46f9_8f7c_f019af76254d.slice/crio-afcc86f3d9d1bf83fdf70914b7d8361a4f845bcbdc4679b2f372ef36deadf11f WatchSource:0}: Error finding container afcc86f3d9d1bf83fdf70914b7d8361a4f845bcbdc4679b2f372ef36deadf11f: Status 404 returned error can't find the container with id afcc86f3d9d1bf83fdf70914b7d8361a4f845bcbdc4679b2f372ef36deadf11f
Sep 10 00:07:34.340997 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:34.340973    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"]
Sep 10 00:07:34.613211 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:34.613131    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:07:34.719618 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:34.719578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t" event={"ID":"1b6f978a-dffe-46f9-8f7c-f019af76254d","Type":"ContainerStarted","Data":"afcc86f3d9d1bf83fdf70914b7d8361a4f845bcbdc4679b2f372ef36deadf11f"}
Sep 10 00:07:35.727014 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:35.726878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t" event={"ID":"1b6f978a-dffe-46f9-8f7c-f019af76254d","Type":"ContainerStarted","Data":"eb37edf238f0b59f967cc44647dca7fa11ccd82b7b0a509a4cc9cd719415e778"}
Sep 10 00:07:35.745951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:35.745546    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t" podStartSLOduration=1.6743778489999999 podStartE2EDuration="2.745524611s" totalImagesPullingTime="1.071146762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:07:35.742326086 +0000 UTC m=+1129.874453317" watchObservedRunningTime="2026-09-10 00:07:35.745524611 +0000 UTC m=+1129.877651841"
Sep 10 00:07:39.566192 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:39.566155    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:40.346576 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:40.346541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:44.067851 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:44.067811    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:44.068401 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:44.068064    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:44.080211 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:44.080187    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:44.786601 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:44.786569    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:07:46.794553 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:46.794435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:46.874275 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:46.874239    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:07:58.796214 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:58.796177    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:07:58.887402 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:07:58.887369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:02.690600 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:02.690561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:08.836619 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:08.836541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:09.124048 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:09.123970    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:09.208086 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:09.208055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:16.802824 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:16.802786    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:08:19.496290 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:19.496255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:20.213781 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:20.213744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:26.138911 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:26.138878    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:26.243351 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:26.243318    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:26.343265 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:26.343235    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:26.438842 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:26.438761    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:27.068527 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:27.068490    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:27.158064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:27.158027    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:27.262357 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:27.262322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:28.656141 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:28.656108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:33.175655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.175620    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"]
Sep 10 00:08:33.176144 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.176129    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fab835e-6337-419a-b41e-659bca043d5e" containerName="istio-proxy"
Sep 10 00:08:33.178246 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.178230    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"
Sep 10 00:08:33.180655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.180634    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 00:08:33.180761 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.180639    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxc4l\""
Sep 10 00:08:33.186160 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.185705    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"]
Sep 10 00:08:33.262982 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.262952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aecd851d-3084-42bf-beb9-842acdec18da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8376bc-6swsg\" (UID: \"aecd851d-3084-42bf-beb9-842acdec18da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"
Sep 10 00:08:33.364386 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.364354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aecd851d-3084-42bf-beb9-842acdec18da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8376bc-6swsg\" (UID: \"aecd851d-3084-42bf-beb9-842acdec18da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"
Sep 10 00:08:33.364947 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.364915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aecd851d-3084-42bf-beb9-842acdec18da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8376bc-6swsg\" (UID: \"aecd851d-3084-42bf-beb9-842acdec18da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"
Sep 10 00:08:33.491248 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.491180    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"
Sep 10 00:08:33.786523 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:33.786497    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"]
Sep 10 00:08:33.788875 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:08:33.788846    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecd851d_3084_42bf_beb9_842acdec18da.slice/crio-311d04ba61ccb44eafd5395968c7314c34ccd24ec98e219b0788a73b90d8cb1b WatchSource:0}: Error finding container 311d04ba61ccb44eafd5395968c7314c34ccd24ec98e219b0788a73b90d8cb1b: Status 404 returned error can't find the container with id 311d04ba61ccb44eafd5395968c7314c34ccd24ec98e219b0788a73b90d8cb1b
Sep 10 00:08:34.047849 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:34.047817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg" event={"ID":"aecd851d-3084-42bf-beb9-842acdec18da","Type":"ContainerStarted","Data":"40178fc5bc53175bfabe1a10d2158d70ba1e7e538dba9af570382db4e64d725b"}
Sep 10 00:08:34.048016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:34.047875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg" event={"ID":"aecd851d-3084-42bf-beb9-842acdec18da","Type":"ContainerStarted","Data":"311d04ba61ccb44eafd5395968c7314c34ccd24ec98e219b0788a73b90d8cb1b"}
Sep 10 00:08:34.069117 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:34.069070    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg" podStartSLOduration=1.069055928 podStartE2EDuration="1.069055928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:08:34.067499111 +0000 UTC m=+1188.199626341" watchObservedRunningTime="2026-09-10 00:08:34.069055928 +0000 UTC m=+1188.201183155"
Sep 10 00:08:34.467365 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:34.467285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:35.054992 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:35.054958    2560 generic.go:356] "Generic (PLEG): container finished" podID="aecd851d-3084-42bf-beb9-842acdec18da" containerID="40178fc5bc53175bfabe1a10d2158d70ba1e7e538dba9af570382db4e64d725b" exitCode=0
Sep 10 00:08:35.055180 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:35.055053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg" event={"ID":"aecd851d-3084-42bf-beb9-842acdec18da","Type":"ContainerDied","Data":"40178fc5bc53175bfabe1a10d2158d70ba1e7e538dba9af570382db4e64d725b"}
Sep 10 00:08:35.109180 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:35.109144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:08:36.227252 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:36.227217    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"
Sep 10 00:08:36.293499 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:36.293458    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aecd851d-3084-42bf-beb9-842acdec18da-maas-api-service-ca\") pod \"aecd851d-3084-42bf-beb9-842acdec18da\" (UID: \"aecd851d-3084-42bf-beb9-842acdec18da\") "
Sep 10 00:08:36.293911 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:36.293881    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aecd851d-3084-42bf-beb9-842acdec18da-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aecd851d-3084-42bf-beb9-842acdec18da" (UID: "aecd851d-3084-42bf-beb9-842acdec18da"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:08:36.395199 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:36.395163    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aecd851d-3084-42bf-beb9-842acdec18da-maas-api-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:08:36.505393 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:36.505354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:37.067697 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:37.067668    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"
Sep 10 00:08:37.067867 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:37.067700    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg" event={"ID":"aecd851d-3084-42bf-beb9-842acdec18da","Type":"ContainerDied","Data":"311d04ba61ccb44eafd5395968c7314c34ccd24ec98e219b0788a73b90d8cb1b"}
Sep 10 00:08:37.067867 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:37.067748    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="311d04ba61ccb44eafd5395968c7314c34ccd24ec98e219b0788a73b90d8cb1b"
Sep 10 00:08:37.164141 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:37.164107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:41.090743 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.090711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:41.192519 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.192468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:41.292357 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.292327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:41.540979 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.540876    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"]
Sep 10 00:08:41.541522 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.541498    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aecd851d-3084-42bf-beb9-842acdec18da" containerName="revoke-keys"
Sep 10 00:08:41.541522 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.541518    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aecd851d-3084-42bf-beb9-842acdec18da" containerName="revoke-keys"
Sep 10 00:08:41.541721 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.541595    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aecd851d-3084-42bf-beb9-842acdec18da" containerName="revoke-keys"
Sep 10 00:08:41.544058 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.544035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.546711 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.546689    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cb0fe265-openshift-default-dockercfg-86qnr\""
Sep 10 00:08:41.557034 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.557009    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"]
Sep 10 00:08:41.569654 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.569624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:41.648535 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.648494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istiod-ca-cert\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.648847 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.648824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-token\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.649006 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.648986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-data\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.649158 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.649142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-certs\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.649279 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.649264    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-socket\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.649385 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.649371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-credential-socket\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.649502 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.649489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-envoy\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.649655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.649634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhnzx\" (UniqueName: \"kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-kube-api-access-jhnzx\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.649772 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.649758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-podinfo\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.750445 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-token\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.750445 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-data\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.750719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-certs\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.750719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-socket\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.750719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750665    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-credential-socket\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.750719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-envoy\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.750921 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhnzx\" (UniqueName: \"kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-kube-api-access-jhnzx\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.750921 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-podinfo\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.750921 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750839    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:41.750921 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istiod-ca-cert\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.750921 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.750879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-certs\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.751211 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.751043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-data\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.751211 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.751158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-socket\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.751211 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.751196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-credential-socket\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.751746 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.751697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istiod-ca-cert\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.754293 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.754264    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-envoy\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.755497 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.755455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-podinfo\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.758915 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.758872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhnzx\" (UniqueName: \"kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-kube-api-access-jhnzx\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.759599 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.759561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-token\") pod \"e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") " pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:41.856368 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:41.856330    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:42.138550 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:42.138516    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"]
Sep 10 00:08:42.139713 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:08:42.139689    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b47ddf_3763_4c8d_90b6_c655fe235fbe.slice/crio-e9ef00180ef3bf9d6a3980224efa368ac7ebd60c07f0973992057f9c523a9b79 WatchSource:0}: Error finding container e9ef00180ef3bf9d6a3980224efa368ac7ebd60c07f0973992057f9c523a9b79: Status 404 returned error can't find the container with id e9ef00180ef3bf9d6a3980224efa368ac7ebd60c07f0973992057f9c523a9b79
Sep 10 00:08:42.142061 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:42.142024    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:08:42.142165 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:42.142090    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:08:42.142165 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:42.142116    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:08:43.101707 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.101668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" event={"ID":"e0b47ddf-3763-4c8d-90b6-c655fe235fbe","Type":"ContainerStarted","Data":"94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9"}
Sep 10 00:08:43.101870 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.101731    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" event={"ID":"e0b47ddf-3763-4c8d-90b6-c655fe235fbe","Type":"ContainerStarted","Data":"e9ef00180ef3bf9d6a3980224efa368ac7ebd60c07f0973992057f9c523a9b79"}
Sep 10 00:08:43.122038 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.121991    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" podStartSLOduration=2.121977142 podStartE2EDuration="2.121977142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:08:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:08:43.120448429 +0000 UTC m=+1197.252575660" watchObservedRunningTime="2026-09-10 00:08:43.121977142 +0000 UTC m=+1197.254104364"
Sep 10 00:08:43.633927 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.633887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:43.701910 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.701882    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:43.802323 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.802289    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:43.838732 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.838694    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"]
Sep 10 00:08:43.840745 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.840722    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8376bc-6swsg"]
Sep 10 00:08:43.857439 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.857401    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:43.862310 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.862287    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:43.991655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:43.991559    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:44.107618 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:44.107588    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:44.108421 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:44.108398    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:08:44.290373 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:44.290295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:44.340512 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:44.340482    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aecd851d-3084-42bf-beb9-842acdec18da" path="/var/lib/kubelet/pods/aecd851d-3084-42bf-beb9-842acdec18da/volumes"
Sep 10 00:08:44.646491 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:44.646460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:46.365046 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:46.365020    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:08:46.365437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:46.365020    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:08:47.184767 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:47.184734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:47.282192 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:47.282141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:48.297425 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.297393    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"]
Sep 10 00:08:48.301153 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.301126    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.304208 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.304185    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cb0fe265-serving-cert\""
Sep 10 00:08:48.305438 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.305416    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 00:08:48.305578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.305413    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h47kt\""
Sep 10 00:08:48.305578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.305530    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 00:08:48.305751 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.305671    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 00:08:48.314804 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.314780    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"]
Sep 10 00:08:48.339255 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.339232    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:48.421058 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.420998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-metrics-certs\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.421265 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.421140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-maas-api-tls\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.421265 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.421188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j9cj\" (UniqueName: \"kubernetes.io/projected/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-kube-api-access-9j9cj\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.421383 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.421279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-openshift-service-ca\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.439294 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.439256    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:48.522242 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.522204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-metrics-certs\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.522430 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.522273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-maas-api-tls\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.522430 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.522304    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j9cj\" (UniqueName: \"kubernetes.io/projected/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-kube-api-access-9j9cj\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.522554 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.522446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-openshift-service-ca\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.523124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.523089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-openshift-service-ca\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.524631 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.524609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-metrics-certs\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.524771 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.524755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-maas-api-tls\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.529766 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.529743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j9cj\" (UniqueName: \"kubernetes.io/projected/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-kube-api-access-9j9cj\") pod \"maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.538449 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.538416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:48.616258 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.616203    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:48.843450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.843412    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:48.918977 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:08:48.918924    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b1ddf1_56c5_41fa_ae5d_adfb76a6d917.slice/crio-2883783e2a9caffb15a21a4c1cd87e7d533d9f45c5ab3ea701846ae405467d04 WatchSource:0}: Error finding container 2883783e2a9caffb15a21a4c1cd87e7d533d9f45c5ab3ea701846ae405467d04: Status 404 returned error can't find the container with id 2883783e2a9caffb15a21a4c1cd87e7d533d9f45c5ab3ea701846ae405467d04
Sep 10 00:08:48.921063 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:48.921040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"]
Sep 10 00:08:49.020874 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:49.020836    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:49.151268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:49.149891    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844" event={"ID":"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917","Type":"ContainerStarted","Data":"2883783e2a9caffb15a21a4c1cd87e7d533d9f45c5ab3ea701846ae405467d04"}
Sep 10 00:08:49.381267 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:49.381232    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:52.171923 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:52.171868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844" event={"ID":"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917","Type":"ContainerStarted","Data":"8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f"}
Sep 10 00:08:52.172412 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:52.171964    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:52.189195 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:52.189148    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844" podStartSLOduration=1.7520049279999999 podStartE2EDuration="4.189133416s" totalImagesPullingTime="2.437128488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:08:52.186989769 +0000 UTC m=+1206.319116996" watchObservedRunningTime="2026-09-10 00:08:52.189133416 +0000 UTC m=+1206.321260685"
Sep 10 00:08:55.199771 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:55.199740    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:55.460956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:55.460852    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"]
Sep 10 00:08:55.461220 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:55.461191    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy" containerID="cri-o://8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c" gracePeriod=30
Sep 10 00:08:55.479260 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:55.479226    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:55.943524 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:55.943492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:56.229320 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.229240    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"]
Sep 10 00:08:56.233348 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.233325    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.235860 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.235840    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-c59d42-openshift-default-dockercfg-jftbj\""
Sep 10 00:08:56.245242 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.245206    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"]
Sep 10 00:08:56.352958 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.352439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:56.408716 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.408682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-data\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.408716 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.408721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-socket\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.409088 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.408750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-certs\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.409088 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.408880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istiod-ca-cert\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.409088 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.408966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-envoy\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.409088 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.409047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-credential-socket\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.409283 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.409091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7sls\" (UniqueName: \"kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-kube-api-access-r7sls\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.409283 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.409160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-token\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.409283 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.409211    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-podinfo\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510242 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-credential-socket\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510242 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7sls\" (UniqueName: \"kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-kube-api-access-r7sls\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-token\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-podinfo\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-data\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-socket\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-certs\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istiod-ca-cert\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510802 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-envoy\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510802 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-credential-socket\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510802 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-certs\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.510802 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510784    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-data\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.511015 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.510869    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-socket\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.511113 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.511094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istiod-ca-cert\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.512635 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.512615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-envoy\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.512746 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.512726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-podinfo\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.524359 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.524337    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-token\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.524359 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.524347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7sls\" (UniqueName: \"kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-kube-api-access-r7sls\") pod \"e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") " pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.547861 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.547839    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:56.669817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.669782    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:56.824266 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.824234    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"]
Sep 10 00:08:56.826168 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:08:56.826144    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb1e505_00dc_4ce8_ac97_a1db9cf30761.slice/crio-ee8b392693950271f3254074fa22734bbbae2711adc110cb08794da2f71bf2a3 WatchSource:0}: Error finding container ee8b392693950271f3254074fa22734bbbae2711adc110cb08794da2f71bf2a3: Status 404 returned error can't find the container with id ee8b392693950271f3254074fa22734bbbae2711adc110cb08794da2f71bf2a3
Sep 10 00:08:56.828358 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.828328    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:08:56.828425 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.828391    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:08:56.828425 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:56.828420    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:08:57.203051 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:57.202964    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t" event={"ID":"fcb1e505-00dc-4ce8-ac97-a1db9cf30761","Type":"ContainerStarted","Data":"32f92092e971fb4789a2d40b1965e9f30b1508abfbfcef3c158e6a615fc4e182"}
Sep 10 00:08:57.203051 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:57.203038    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t" event={"ID":"fcb1e505-00dc-4ce8-ac97-a1db9cf30761","Type":"ContainerStarted","Data":"ee8b392693950271f3254074fa22734bbbae2711adc110cb08794da2f71bf2a3"}
Sep 10 00:08:57.220754 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:57.220704    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t" podStartSLOduration=1.220688054 podStartE2EDuration="1.220688054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:08:57.220328332 +0000 UTC m=+1211.352455570" watchObservedRunningTime="2026-09-10 00:08:57.220688054 +0000 UTC m=+1211.352815283"
Sep 10 00:08:57.491411 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:57.491327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:57.548232 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:57.548201    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:57.554105 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:57.554079    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:57.577839 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:57.577812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:57.704267 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:57.704230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:08:58.183352 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:58.183323    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:08:58.209177 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:58.209141    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:58.210027 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:58.210008    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:08:59.772731 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:59.772688    2560 patch_prober.go:28] interesting pod/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 00:08:59.773286 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:08:59.772770    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 00:09:00.715527 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.715503    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:09:00.855182 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.855060    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-data\") pod \"a16f66c6-685e-43e6-9891-7e18f9ec1904\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") "
Sep 10 00:09:00.855182 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.855127    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-podinfo\") pod \"a16f66c6-685e-43e6-9891-7e18f9ec1904\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") "
Sep 10 00:09:00.855741 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.855379    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-data" (OuterVolumeSpecName: "istio-data") pod "a16f66c6-685e-43e6-9891-7e18f9ec1904" (UID: "a16f66c6-685e-43e6-9891-7e18f9ec1904"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:09:00.855890 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.855864    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-credential-socket\") pod \"a16f66c6-685e-43e6-9891-7e18f9ec1904\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") "
Sep 10 00:09:00.856049 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.855963    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-token\") pod \"a16f66c6-685e-43e6-9891-7e18f9ec1904\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") "
Sep 10 00:09:00.856049 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.856020    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a16f66c6-685e-43e6-9891-7e18f9ec1904-istiod-ca-cert\") pod \"a16f66c6-685e-43e6-9891-7e18f9ec1904\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") "
Sep 10 00:09:00.856172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.856048    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-envoy\") pod \"a16f66c6-685e-43e6-9891-7e18f9ec1904\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") "
Sep 10 00:09:00.856172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.856088    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rn46\" (UniqueName: \"kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-kube-api-access-2rn46\") pod \"a16f66c6-685e-43e6-9891-7e18f9ec1904\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") "
Sep 10 00:09:00.856278 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.856221    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-socket\") pod \"a16f66c6-685e-43e6-9891-7e18f9ec1904\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") "
Sep 10 00:09:00.856278 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.856268    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-certs\") pod \"a16f66c6-685e-43e6-9891-7e18f9ec1904\" (UID: \"a16f66c6-685e-43e6-9891-7e18f9ec1904\") "
Sep 10 00:09:00.856799 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.856616    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:00.856799 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.856629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a16f66c6-685e-43e6-9891-7e18f9ec1904-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a16f66c6-685e-43e6-9891-7e18f9ec1904" (UID: "a16f66c6-685e-43e6-9891-7e18f9ec1904"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:09:00.856799 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.856788    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a16f66c6-685e-43e6-9891-7e18f9ec1904" (UID: "a16f66c6-685e-43e6-9891-7e18f9ec1904"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:09:00.857146 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.857090    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a16f66c6-685e-43e6-9891-7e18f9ec1904" (UID: "a16f66c6-685e-43e6-9891-7e18f9ec1904"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:09:00.857251 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.857221    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a16f66c6-685e-43e6-9891-7e18f9ec1904" (UID: "a16f66c6-685e-43e6-9891-7e18f9ec1904"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:09:00.858245 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.858218    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a16f66c6-685e-43e6-9891-7e18f9ec1904" (UID: "a16f66c6-685e-43e6-9891-7e18f9ec1904"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:09:00.858723 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.858697    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a16f66c6-685e-43e6-9891-7e18f9ec1904" (UID: "a16f66c6-685e-43e6-9891-7e18f9ec1904"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:09:00.859068 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.859047    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-kube-api-access-2rn46" (OuterVolumeSpecName: "kube-api-access-2rn46") pod "a16f66c6-685e-43e6-9891-7e18f9ec1904" (UID: "a16f66c6-685e-43e6-9891-7e18f9ec1904"). InnerVolumeSpecName "kube-api-access-2rn46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:09:00.859268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.859248    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-token" (OuterVolumeSpecName: "istio-token") pod "a16f66c6-685e-43e6-9891-7e18f9ec1904" (UID: "a16f66c6-685e-43e6-9891-7e18f9ec1904"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:09:00.959476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.959342    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:00.959476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.959376    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a16f66c6-685e-43e6-9891-7e18f9ec1904-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:00.959476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.959389    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:00.959476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.959401    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rn46\" (UniqueName: \"kubernetes.io/projected/a16f66c6-685e-43e6-9891-7e18f9ec1904-kube-api-access-2rn46\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:00.959476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.959414    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:00.959476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.959426    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:00.959476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.959439    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a16f66c6-685e-43e6-9891-7e18f9ec1904-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:00.959476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:00.959450    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16f66c6-685e-43e6-9891-7e18f9ec1904-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:01.227128 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.227038    2560 generic.go:356] "Generic (PLEG): container finished" podID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerID="8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c" exitCode=0
Sep 10 00:09:01.227128 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.227089    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"
Sep 10 00:09:01.227128 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.227098    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" event={"ID":"a16f66c6-685e-43e6-9891-7e18f9ec1904","Type":"ContainerDied","Data":"8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c"}
Sep 10 00:09:01.227371 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.227139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq" event={"ID":"a16f66c6-685e-43e6-9891-7e18f9ec1904","Type":"ContainerDied","Data":"1f0d33888679368a6a11e145a56e1c9a2fdd3196d4060cfe99beecd37d92526b"}
Sep 10 00:09:01.227371 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.227162    2560 scope.go:117] "RemoveContainer" containerID="8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c"
Sep 10 00:09:01.237295 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.237275    2560 scope.go:117] "RemoveContainer" containerID="dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d"
Sep 10 00:09:01.245554 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.245534    2560 scope.go:117] "RemoveContainer" containerID="8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c"
Sep 10 00:09:01.245920 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:09:01.245887    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c\": container with ID starting with 8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c not found: ID does not exist" containerID="8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c"
Sep 10 00:09:01.246047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.245944    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c"} err="failed to get container status \"8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c\": rpc error: code = NotFound desc = could not find container \"8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c\": container with ID starting with 8a6d5f2f882886b0cc2df2f2d8255f113d77e4daa0ce19f04e52d1cb2c86885c not found: ID does not exist"
Sep 10 00:09:01.246047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.245968    2560 scope.go:117] "RemoveContainer" containerID="dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d"
Sep 10 00:09:01.246617 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:09:01.246591    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d\": container with ID starting with dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d not found: ID does not exist" containerID="dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d"
Sep 10 00:09:01.246698 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.246626    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d"} err="failed to get container status \"dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d\": rpc error: code = NotFound desc = could not find container \"dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d\": container with ID starting with dc554a9f18d1d56597195b17210ac1c7b266dc22d1a55b95ce0dbdc3a44abf8d not found: ID does not exist"
Sep 10 00:09:01.248764 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.248745    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"]
Sep 10 00:09:01.251960 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:01.251924    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq"]
Sep 10 00:09:02.340842 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:02.340810    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" path="/var/lib/kubelet/pods/a16f66c6-685e-43e6-9891-7e18f9ec1904/volumes"
Sep 10 00:09:09.005598 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:09.005558    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:09:12.135171 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:12.135128    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:12.756250 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:12.756213    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:12.855317 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:12.855280    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:13.171821 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:13.171786    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:18.878286 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:18.878251    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:18.938984 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:18.938945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:20.352034 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:20.352002    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerID="94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9" exitCode=0
Sep 10 00:09:20.352475 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:20.352070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" event={"ID":"e0b47ddf-3763-4c8d-90b6-c655fe235fbe","Type":"ContainerDied","Data":"94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9"}
Sep 10 00:09:20.352563 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:20.352508    2560 scope.go:117] "RemoveContainer" containerID="94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9"
Sep 10 00:09:20.353690 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:20.353660    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:09:20.353801 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:20.353744    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:09:20.353801 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:20.353793    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:09:21.359551 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:21.359516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" event={"ID":"e0b47ddf-3763-4c8d-90b6-c655fe235fbe","Type":"ContainerStarted","Data":"dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0"}
Sep 10 00:09:21.857353 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:21.857308    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:09:21.857578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:21.857444    2560 patch_prober.go:28] interesting pod/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 00:09:21.857578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:21.857487    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 00:09:22.857287 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:22.857235    2560 patch_prober.go:28] interesting pod/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 00:09:22.857808 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:22.857326    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 00:09:23.857694 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:23.857655    2560 patch_prober.go:28] interesting pod/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 00:09:23.858356 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:23.858321    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 00:09:24.856843 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:24.856803    2560 patch_prober.go:28] interesting pod/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 00:09:24.857193 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:24.857151    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 00:09:25.857585 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:25.857536    2560 patch_prober.go:28] interesting pod/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 00:09:25.858117 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:25.857619    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 00:09:26.857694 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:26.857643    2560 patch_prober.go:28] interesting pod/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 00:09:26.858236 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:26.857720    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 00:09:27.861452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:27.861398    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:09:27.861991 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:27.861798    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:09:27.862418 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:27.862397    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:09:28.102552 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:28.102504    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:29.317118 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:29.317084    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:29.874636 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:29.874598    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"]
Sep 10 00:09:29.874951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:29.874905    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844" podUID="56b1ddf1-56c5-41fa-ae5d-adfb76a6d917" containerName="maas-api" containerID="cri-o://8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f" gracePeriod=30
Sep 10 00:09:29.902431 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:29.902403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:30.010388 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.010355    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:30.077776 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.077744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:30.121697 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.121670    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:09:30.148548 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.148476    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:30.268371 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.268326    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j9cj\" (UniqueName: \"kubernetes.io/projected/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-kube-api-access-9j9cj\") pod \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") "
Sep 10 00:09:30.268565 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.268390    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-metrics-certs\") pod \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") "
Sep 10 00:09:30.268565 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.268503    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-openshift-service-ca\") pod \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") "
Sep 10 00:09:30.268565 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.268534    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-maas-api-tls\") pod \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\" (UID: \"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917\") "
Sep 10 00:09:30.275575 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.271904    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "56b1ddf1-56c5-41fa-ae5d-adfb76a6d917" (UID: "56b1ddf1-56c5-41fa-ae5d-adfb76a6d917"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:09:30.275575 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.272242    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56b1ddf1-56c5-41fa-ae5d-adfb76a6d917" (UID: "56b1ddf1-56c5-41fa-ae5d-adfb76a6d917"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:09:30.286139 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.285089    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56b1ddf1-56c5-41fa-ae5d-adfb76a6d917" (UID: "56b1ddf1-56c5-41fa-ae5d-adfb76a6d917"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:09:30.286139 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.285550    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-kube-api-access-9j9cj" (OuterVolumeSpecName: "kube-api-access-9j9cj") pod "56b1ddf1-56c5-41fa-ae5d-adfb76a6d917" (UID: "56b1ddf1-56c5-41fa-ae5d-adfb76a6d917"). InnerVolumeSpecName "kube-api-access-9j9cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:09:30.370092 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.370051    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:30.370092 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.370082    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:30.370092 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.370092    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j9cj\" (UniqueName: \"kubernetes.io/projected/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-kube-api-access-9j9cj\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:30.370092 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.370100    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917-metrics-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:30.420447 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.420343    2560 generic.go:356] "Generic (PLEG): container finished" podID="56b1ddf1-56c5-41fa-ae5d-adfb76a6d917" containerID="8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f" exitCode=0
Sep 10 00:09:30.420447 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.420402    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"
Sep 10 00:09:30.420447 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.420430    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844" event={"ID":"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917","Type":"ContainerDied","Data":"8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f"}
Sep 10 00:09:30.420758 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.420491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844" event={"ID":"56b1ddf1-56c5-41fa-ae5d-adfb76a6d917","Type":"ContainerDied","Data":"2883783e2a9caffb15a21a4c1cd87e7d533d9f45c5ab3ea701846ae405467d04"}
Sep 10 00:09:30.420758 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.420524    2560 scope.go:117] "RemoveContainer" containerID="8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f"
Sep 10 00:09:30.421667 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.421642    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:30.432688 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.432655    2560 scope.go:117] "RemoveContainer" containerID="8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f"
Sep 10 00:09:30.433033 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:09:30.433012    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f\": container with ID starting with 8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f not found: ID does not exist" containerID="8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f"
Sep 10 00:09:30.433127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.433043    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f"} err="failed to get container status \"8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f\": rpc error: code = NotFound desc = could not find container \"8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f\": container with ID starting with 8eff2d3a074929b76bb91a1f23c32f3b1d9eb27663e87e364c58cb35f4f9cd9f not found: ID does not exist"
Sep 10 00:09:30.438692 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.438408    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"]
Sep 10 00:09:30.440789 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:30.440766    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cb0fe265-56b4d4cd7b-6l844"]
Sep 10 00:09:31.720577 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:31.720539    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:32.347779 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:32.347729    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56b1ddf1-56c5-41fa-ae5d-adfb76a6d917" path="/var/lib/kubelet/pods/56b1ddf1-56c5-41fa-ae5d-adfb76a6d917/volumes"
Sep 10 00:09:35.661485 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:35.661452    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:35.802536 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:35.802499    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:09:36.184761 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:36.184725    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:36.278994 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:36.278953    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:36.400902 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:36.400865    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"]
Sep 10 00:09:36.401127 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:36.401098    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy" containerID="cri-o://dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0" gracePeriod=30
Sep 10 00:09:36.426057 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:36.426031    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:36.801869 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:36.801829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:36.899171 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:36.899142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:36.999456 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:36.999415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:41.663171 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.663142    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:09:41.677704 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.677647    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-podinfo\") pod \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") "
Sep 10 00:09:41.677704 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.677686    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-token\") pod \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") "
Sep 10 00:09:41.677849 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.677726    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-envoy\") pod \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") "
Sep 10 00:09:41.677849 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.677756    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-certs\") pod \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") "
Sep 10 00:09:41.677849 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.677772    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhnzx\" (UniqueName: \"kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-kube-api-access-jhnzx\") pod \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") "
Sep 10 00:09:41.677849 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.677840    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-credential-socket\") pod \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") "
Sep 10 00:09:41.678065 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.677891    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istiod-ca-cert\") pod \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") "
Sep 10 00:09:41.678065 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.677921    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-data\") pod \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") "
Sep 10 00:09:41.678065 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.677979    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-socket\") pod \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\" (UID: \"e0b47ddf-3763-4c8d-90b6-c655fe235fbe\") "
Sep 10 00:09:41.678231 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.678203    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e0b47ddf-3763-4c8d-90b6-c655fe235fbe" (UID: "e0b47ddf-3763-4c8d-90b6-c655fe235fbe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:09:41.678316 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.678289    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e0b47ddf-3763-4c8d-90b6-c655fe235fbe" (UID: "e0b47ddf-3763-4c8d-90b6-c655fe235fbe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:09:41.678445 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.678423    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:41.678524 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.678450    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:41.678524 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.678424    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-data" (OuterVolumeSpecName: "istio-data") pod "e0b47ddf-3763-4c8d-90b6-c655fe235fbe" (UID: "e0b47ddf-3763-4c8d-90b6-c655fe235fbe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:09:41.678524 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.678445    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e0b47ddf-3763-4c8d-90b6-c655fe235fbe" (UID: "e0b47ddf-3763-4c8d-90b6-c655fe235fbe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:09:41.678524 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.678456    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e0b47ddf-3763-4c8d-90b6-c655fe235fbe" (UID: "e0b47ddf-3763-4c8d-90b6-c655fe235fbe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:09:41.680011 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.679988    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e0b47ddf-3763-4c8d-90b6-c655fe235fbe" (UID: "e0b47ddf-3763-4c8d-90b6-c655fe235fbe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:09:41.680241 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.680195    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-kube-api-access-jhnzx" (OuterVolumeSpecName: "kube-api-access-jhnzx") pod "e0b47ddf-3763-4c8d-90b6-c655fe235fbe" (UID: "e0b47ddf-3763-4c8d-90b6-c655fe235fbe"). InnerVolumeSpecName "kube-api-access-jhnzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:09:41.680327 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.680287    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e0b47ddf-3763-4c8d-90b6-c655fe235fbe" (UID: "e0b47ddf-3763-4c8d-90b6-c655fe235fbe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:09:41.680327 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.680290    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0b47ddf-3763-4c8d-90b6-c655fe235fbe" (UID: "e0b47ddf-3763-4c8d-90b6-c655fe235fbe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:09:41.779151 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.779120    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:41.779151 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.779147    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhnzx\" (UniqueName: \"kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-kube-api-access-jhnzx\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:41.779151 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.779159    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:41.779362 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.779167    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:41.779362 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.779176    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:41.779362 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.779183    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:41.779362 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:41.779191    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0b47ddf-3763-4c8d-90b6-c655fe235fbe-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:09:42.489465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.489433    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerID="dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0" exitCode=0
Sep 10 00:09:42.489645 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.489495    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"
Sep 10 00:09:42.489645 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.489527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" event={"ID":"e0b47ddf-3763-4c8d-90b6-c655fe235fbe","Type":"ContainerDied","Data":"dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0"}
Sep 10 00:09:42.489645 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.489582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m" event={"ID":"e0b47ddf-3763-4c8d-90b6-c655fe235fbe","Type":"ContainerDied","Data":"e9ef00180ef3bf9d6a3980224efa368ac7ebd60c07f0973992057f9c523a9b79"}
Sep 10 00:09:42.489645 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.489604    2560 scope.go:117] "RemoveContainer" containerID="dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0"
Sep 10 00:09:42.499052 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.498830    2560 scope.go:117] "RemoveContainer" containerID="94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9"
Sep 10 00:09:42.508114 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.508074    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"]
Sep 10 00:09:42.508350 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.508323    2560 scope.go:117] "RemoveContainer" containerID="dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0"
Sep 10 00:09:42.508894 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:09:42.508760    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0\": container with ID starting with dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0 not found: ID does not exist" containerID="dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0"
Sep 10 00:09:42.508894 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.508797    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0"} err="failed to get container status \"dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0\": rpc error: code = NotFound desc = could not find container \"dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0\": container with ID starting with dc4963de1539ca89177e1970b21654a5502292409c29afd3bfc6e41bc9bfe4c0 not found: ID does not exist"
Sep 10 00:09:42.508894 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.508820    2560 scope.go:117] "RemoveContainer" containerID="94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9"
Sep 10 00:09:42.509203 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:09:42.509177    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9\": container with ID starting with 94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9 not found: ID does not exist" containerID="94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9"
Sep 10 00:09:42.509354 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.509326    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9"} err="failed to get container status \"94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9\": rpc error: code = NotFound desc = could not find container \"94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9\": container with ID starting with 94894ef1e06b779a2ffa14dbcab2e01199968e93dfd048863df786c27af1abe9 not found: ID does not exist"
Sep 10 00:09:42.511487 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.511467    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m"]
Sep 10 00:09:42.679843 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.679772    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:42.739955 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.739900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:42.825411 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.825378    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:42.921984 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:42.921955    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:43.021842 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:43.021751    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:44.340472 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:44.340440    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" path="/var/lib/kubelet/pods/e0b47ddf-3763-4c8d-90b6-c655fe235fbe/volumes"
Sep 10 00:09:48.765198 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:48.765144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:48.892269 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:48.892238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:49.388353 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.388319    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:49.645765 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.645672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:49.907191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907103    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"]
Sep 10 00:09:49.907629 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907562    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy"
Sep 10 00:09:49.907629 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907576    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy"
Sep 10 00:09:49.907629 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907610    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b1ddf1-56c5-41fa-ae5d-adfb76a6d917" containerName="maas-api"
Sep 10 00:09:49.907629 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907616    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b1ddf1-56c5-41fa-ae5d-adfb76a6d917" containerName="maas-api"
Sep 10 00:09:49.907629 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907624    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy"
Sep 10 00:09:49.907629 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907629    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy"
Sep 10 00:09:49.907987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907649    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy"
Sep 10 00:09:49.907987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907655    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy"
Sep 10 00:09:49.907987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907721    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy"
Sep 10 00:09:49.907987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907732    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="56b1ddf1-56c5-41fa-ae5d-adfb76a6d917" containerName="maas-api"
Sep 10 00:09:49.907987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907739    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy"
Sep 10 00:09:49.907987 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.907745    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy"
Sep 10 00:09:49.912194 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.912169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:49.914638 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.914615    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-1d36d9-openshift-default-dockercfg-g6fk6\""
Sep 10 00:09:49.922110 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.922087    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"]
Sep 10 00:09:49.934511 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.934486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:49.952574 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.952544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2de27466-3553-4492-842c-21c42ce7fb99-istiod-ca-cert\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:49.952703 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.952589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7p24\" (UniqueName: \"kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-kube-api-access-f7p24\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:49.952703 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.952689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-credential-socket\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:49.952780 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.952713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2de27466-3553-4492-842c-21c42ce7fb99-istio-podinfo\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:49.952780 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.952741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-istio-token\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:49.952866 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.952819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-socket\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:49.952866 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.952851    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-certs\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:49.952988 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.952882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-envoy\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:49.952988 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:49.952971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-data\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.054340 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.054295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-data\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.054576 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.054357    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2de27466-3553-4492-842c-21c42ce7fb99-istiod-ca-cert\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.054576 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.054385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7p24\" (UniqueName: \"kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-kube-api-access-f7p24\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.054576 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.054456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-credential-socket\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.054576 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.054482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2de27466-3553-4492-842c-21c42ce7fb99-istio-podinfo\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.054576 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.054509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-istio-token\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.054853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.054590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-socket\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.054853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.054624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-certs\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.054853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.054655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-envoy\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.054853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.054773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-data\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.055112 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.055036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-socket\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.055112 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.055076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-certs\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.055340 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.055315    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-credential-socket\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.056152 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.055959    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2de27466-3553-4492-842c-21c42ce7fb99-istiod-ca-cert\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.057462 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.057438    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-envoy\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.057673 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.057643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2de27466-3553-4492-842c-21c42ce7fb99-istio-podinfo\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.062299 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.062276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-istio-token\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.062476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.062458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7p24\" (UniqueName: \"kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-kube-api-access-f7p24\") pod \"e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") " pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.224060 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.223984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:50.304044 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.304008    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:50.504518 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.504493    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"]
Sep 10 00:09:50.506094 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:09:50.506066    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de27466_3553_4492_842c_21c42ce7fb99.slice/crio-3d7698cac8313483f520fbff51f5f76f9d14172f392c92b115132ce514394ca2 WatchSource:0}: Error finding container 3d7698cac8313483f520fbff51f5f76f9d14172f392c92b115132ce514394ca2: Status 404 returned error can't find the container with id 3d7698cac8313483f520fbff51f5f76f9d14172f392c92b115132ce514394ca2
Sep 10 00:09:50.508506 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.508473    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:09:50.508615 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.508545    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:09:50.508615 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.508588    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:09:50.540698 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:50.540663    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" event={"ID":"2de27466-3553-4492-842c-21c42ce7fb99","Type":"ContainerStarted","Data":"3d7698cac8313483f520fbff51f5f76f9d14172f392c92b115132ce514394ca2"}
Sep 10 00:09:51.548429 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:51.548386    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" event={"ID":"2de27466-3553-4492-842c-21c42ce7fb99","Type":"ContainerStarted","Data":"5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe"}
Sep 10 00:09:51.569924 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:51.569870    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" podStartSLOduration=2.569854234 podStartE2EDuration="2.569854234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:09:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:09:51.56806953 +0000 UTC m=+1265.700196772" watchObservedRunningTime="2026-09-10 00:09:51.569854234 +0000 UTC m=+1265.701981461"
Sep 10 00:09:52.224508 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:52.224470    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:52.229269 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:52.229244    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:52.555479 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:52.555447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:52.556958 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:52.556917    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:09:53.398825 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:53.398782    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:53.493324 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:53.493294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:53.669547 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:53.669466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:54.615050 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.615015    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"]
Sep 10 00:09:54.615457 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.615443    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy"
Sep 10 00:09:54.615502 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.615459    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b47ddf-3763-4c8d-90b6-c655fe235fbe" containerName="istio-proxy"
Sep 10 00:09:54.615548 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.615538    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16f66c6-685e-43e6-9891-7e18f9ec1904" containerName="istio-proxy"
Sep 10 00:09:54.618812 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.618796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.621428 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.621396    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-1d36d9-serving-cert\""
Sep 10 00:09:54.622562 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.622540    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 00:09:54.622730 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.622554    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h47kt\""
Sep 10 00:09:54.622857 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.622553    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 00:09:54.622857 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.622620    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 00:09:54.629630 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.629603    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"]
Sep 10 00:09:54.655094 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.655066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:54.703179 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.703146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.703546 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.703241    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1906d6-5143-4fd2-866c-267ffe7a59bd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.703546 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.703271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sngmb\" (UniqueName: \"kubernetes.io/projected/6b1906d6-5143-4fd2-866c-267ffe7a59bd-kube-api-access-sngmb\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.703546 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.703448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.754085 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.754047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:54.804627 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.804598    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.804814 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.804645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1906d6-5143-4fd2-866c-267ffe7a59bd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.804814 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.804672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sngmb\" (UniqueName: \"kubernetes.io/projected/6b1906d6-5143-4fd2-866c-267ffe7a59bd-kube-api-access-sngmb\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.804814 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:09:54.804763    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-serving-cert: secret "maas-api-e2e-shared-a-w2-1d36d9-serving-cert" not found
Sep 10 00:09:54.805030 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:09:54.804840    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-maas-api-tls podName:6b1906d6-5143-4fd2-866c-267ffe7a59bd nodeName:}" failed. No retries permitted until 2026-09-10 00:09:55.304810556 +0000 UTC m=+1269.436937765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-maas-api-tls") pod "maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v" (UID: "6b1906d6-5143-4fd2-866c-267ffe7a59bd") : secret "maas-api-e2e-shared-a-w2-1d36d9-serving-cert" not found
Sep 10 00:09:54.805030 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.804862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.805347 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.805320    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1906d6-5143-4fd2-866c-267ffe7a59bd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.807238 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.807217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:54.814828 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:54.814804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sngmb\" (UniqueName: \"kubernetes.io/projected/6b1906d6-5143-4fd2-866c-267ffe7a59bd-kube-api-access-sngmb\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:55.100604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:55.100566    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:55.204302 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:55.204271    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:09:55.311010 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:55.310489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:55.313700 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:55.313672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:55.532513 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:55.532429    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:55.803087 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:55.803058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"]
Sep 10 00:09:55.804444 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:09:55.804418    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1906d6_5143_4fd2_866c_267ffe7a59bd.slice/crio-197933784a7fe5172d1ff7ab732d45b37420a3673bde42b85fd22700c8b795e7 WatchSource:0}: Error finding container 197933784a7fe5172d1ff7ab732d45b37420a3673bde42b85fd22700c8b795e7: Status 404 returned error can't find the container with id 197933784a7fe5172d1ff7ab732d45b37420a3673bde42b85fd22700c8b795e7
Sep 10 00:09:55.805761 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:55.805742    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 00:09:56.579148 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:56.579109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v" event={"ID":"6b1906d6-5143-4fd2-866c-267ffe7a59bd","Type":"ContainerStarted","Data":"cab2b1062d0a0e7d4744548ae50df23b2a9a4e9faa850e5130d08d4fd2dfa138"}
Sep 10 00:09:56.579311 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:56.579174    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:09:56.579311 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:56.579192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v" event={"ID":"6b1906d6-5143-4fd2-866c-267ffe7a59bd","Type":"ContainerStarted","Data":"197933784a7fe5172d1ff7ab732d45b37420a3673bde42b85fd22700c8b795e7"}
Sep 10 00:09:56.597309 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:56.597256    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v" podStartSLOduration=2.139032781 podStartE2EDuration="2.597236757s" totalImagesPullingTime="458.203976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:09:56.594349933 +0000 UTC m=+1270.726477173" watchObservedRunningTime="2026-09-10 00:09:56.597236757 +0000 UTC m=+1270.729363982"
Sep 10 00:09:57.977465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:09:57.977427    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:02.590093 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:02.590064    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:10:03.405006 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:03.404969    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:10:10.402475 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:10.402441    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"]
Sep 10 00:10:10.403061 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:10.402698    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t" podUID="fcb1e505-00dc-4ce8-ac97-a1db9cf30761" containerName="istio-proxy" containerID="cri-o://32f92092e971fb4789a2d40b1965e9f30b1508abfbfcef3c158e6a615fc4e182" gracePeriod=30
Sep 10 00:10:10.671426 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:10.671325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:10.771372 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:10.771335    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:10.825380 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:10.825349    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:12.826423 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:12.826387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:13.211247 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:13.211166    2560 patch_prober.go:28] interesting pod/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 00:10:13.211247 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:13.211226    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t" podUID="fcb1e505-00dc-4ce8-ac97-a1db9cf30761" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 00:10:14.689449 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:14.689417    2560 generic.go:356] "Generic (PLEG): container finished" podID="2de27466-3553-4492-842c-21c42ce7fb99" containerID="5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe" exitCode=0
Sep 10 00:10:14.689869 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:14.689490    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" event={"ID":"2de27466-3553-4492-842c-21c42ce7fb99","Type":"ContainerDied","Data":"5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe"}
Sep 10 00:10:14.689963 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:14.689949    2560 scope.go:117] "RemoveContainer" containerID="5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe"
Sep 10 00:10:14.691090 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:14.691058    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:14.691186 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:14.691132    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:14.691186 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:14.691166    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:15.698558 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.698526    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" event={"ID":"2de27466-3553-4492-842c-21c42ce7fb99","Type":"ContainerStarted","Data":"c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b"}
Sep 10 00:10:15.699888 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.699864    2560 generic.go:356] "Generic (PLEG): container finished" podID="fcb1e505-00dc-4ce8-ac97-a1db9cf30761" containerID="32f92092e971fb4789a2d40b1965e9f30b1508abfbfcef3c158e6a615fc4e182" exitCode=0
Sep 10 00:10:15.700024 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.699978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t" event={"ID":"fcb1e505-00dc-4ce8-ac97-a1db9cf30761","Type":"ContainerDied","Data":"32f92092e971fb4789a2d40b1965e9f30b1508abfbfcef3c158e6a615fc4e182"}
Sep 10 00:10:15.700101 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.700035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t" event={"ID":"fcb1e505-00dc-4ce8-ac97-a1db9cf30761","Type":"ContainerDied","Data":"ee8b392693950271f3254074fa22734bbbae2711adc110cb08794da2f71bf2a3"}
Sep 10 00:10:15.700101 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.700059    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee8b392693950271f3254074fa22734bbbae2711adc110cb08794da2f71bf2a3"
Sep 10 00:10:15.704347 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.704329    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:10:15.730198 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730171    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istiod-ca-cert\") pod \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") "
Sep 10 00:10:15.730331 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730213    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-socket\") pod \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") "
Sep 10 00:10:15.730331 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730234    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-data\") pod \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") "
Sep 10 00:10:15.730331 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730303    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-certs\") pod \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") "
Sep 10 00:10:15.730496 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730349    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-podinfo\") pod \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") "
Sep 10 00:10:15.730496 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-credential-socket\") pod \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") "
Sep 10 00:10:15.730496 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730435    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7sls\" (UniqueName: \"kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-kube-api-access-r7sls\") pod \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") "
Sep 10 00:10:15.730496 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730464    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-envoy\") pod \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") "
Sep 10 00:10:15.730695 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730506    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-token\") pod \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\" (UID: \"fcb1e505-00dc-4ce8-ac97-a1db9cf30761\") "
Sep 10 00:10:15.730695 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730523    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fcb1e505-00dc-4ce8-ac97-a1db9cf30761" (UID: "fcb1e505-00dc-4ce8-ac97-a1db9cf30761"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:15.730695 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730574    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fcb1e505-00dc-4ce8-ac97-a1db9cf30761" (UID: "fcb1e505-00dc-4ce8-ac97-a1db9cf30761"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:10:15.730695 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730678    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-data" (OuterVolumeSpecName: "istio-data") pod "fcb1e505-00dc-4ce8-ac97-a1db9cf30761" (UID: "fcb1e505-00dc-4ce8-ac97-a1db9cf30761"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:15.730882 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fcb1e505-00dc-4ce8-ac97-a1db9cf30761" (UID: "fcb1e505-00dc-4ce8-ac97-a1db9cf30761"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:15.731017 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.730995    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fcb1e505-00dc-4ce8-ac97-a1db9cf30761" (UID: "fcb1e505-00dc-4ce8-ac97-a1db9cf30761"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:15.731108 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.731085    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:15.731171 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.731110    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:15.731171 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.731124    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:15.731171 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.731138    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:15.731171 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.731151    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:15.732777 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.732748    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-token" (OuterVolumeSpecName: "istio-token") pod "fcb1e505-00dc-4ce8-ac97-a1db9cf30761" (UID: "fcb1e505-00dc-4ce8-ac97-a1db9cf30761"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:10:15.733123 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.733098    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-kube-api-access-r7sls" (OuterVolumeSpecName: "kube-api-access-r7sls") pod "fcb1e505-00dc-4ce8-ac97-a1db9cf30761" (UID: "fcb1e505-00dc-4ce8-ac97-a1db9cf30761"). InnerVolumeSpecName "kube-api-access-r7sls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:10:15.733217 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.733159    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fcb1e505-00dc-4ce8-ac97-a1db9cf30761" (UID: "fcb1e505-00dc-4ce8-ac97-a1db9cf30761"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:10:15.733217 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.733190    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fcb1e505-00dc-4ce8-ac97-a1db9cf30761" (UID: "fcb1e505-00dc-4ce8-ac97-a1db9cf30761"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:15.765962 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.765373    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:15.832302 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.832265    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:15.832302 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.832291    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7sls\" (UniqueName: \"kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-kube-api-access-r7sls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:15.832302 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.832304    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:15.832302 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.832313    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb1e505-00dc-4ce8-ac97-a1db9cf30761-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:15.867833 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:15.867661    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:16.225298 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:16.224916    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:10:16.225298 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:16.224986    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 00:10:16.225298 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:16.225045    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 00:10:16.533668 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:16.533561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:16.705101 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:16.705073    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"
Sep 10 00:10:16.722604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:16.722569    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"]
Sep 10 00:10:16.726430 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:16.726403    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t"]
Sep 10 00:10:17.225222 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:17.225191    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 00:10:17.225413 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:17.225243    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 00:10:18.224925 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.224886    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 00:10:18.225314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.224967    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 00:10:18.328303 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.328274    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:18.339558 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.339531    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcb1e505-00dc-4ce8-ac97-a1db9cf30761" path="/var/lib/kubelet/pods/fcb1e505-00dc-4ce8-ac97-a1db9cf30761/volumes"
Sep 10 00:10:18.635156 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.635123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:18.886194 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.886110    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"]
Sep 10 00:10:18.886623 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.886605    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcb1e505-00dc-4ce8-ac97-a1db9cf30761" containerName="istio-proxy"
Sep 10 00:10:18.886749 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.886658    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcb1e505-00dc-4ce8-ac97-a1db9cf30761" containerName="istio-proxy"
Sep 10 00:10:18.886872 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.886857    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcb1e505-00dc-4ce8-ac97-a1db9cf30761" containerName="istio-proxy"
Sep 10 00:10:18.889873 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.889849    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:18.892388 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.892365    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-870d44-openshift-default-dockercfg-lkhps\""
Sep 10 00:10:18.901513 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.901491    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"]
Sep 10 00:10:18.916545 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.916520    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:18.967466 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.967427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx5ft\" (UniqueName: \"kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-kube-api-access-kx5ft\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:18.967758 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.967737    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-podinfo\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:18.967922 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.967904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-envoy\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:18.968136 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.968116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a26bf91-f389-4522-8d3d-173db5feb1fc-istiod-ca-cert\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:18.968295 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.968278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-credential-socket\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:18.968464 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.968444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-data\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:18.968625 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.968608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-socket\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:18.968769 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.968755    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-token\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:18.968905 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:18.968891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-certs\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.070316 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.070271    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-envoy\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.071074 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.071049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a26bf91-f389-4522-8d3d-173db5feb1fc-istiod-ca-cert\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.071323 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.071307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-credential-socket\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.071458 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.071443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-data\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.072748 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.072722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-socket\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.072910 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.072894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-token\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.073061 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.073042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-certs\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.074246 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.074219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx5ft\" (UniqueName: \"kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-kube-api-access-kx5ft\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.074437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.074411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-podinfo\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.074582 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.073419    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-socket\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.075431 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.072644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-data\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.075578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.073971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-certs\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.075689 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.074153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-envoy\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.075792 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.072440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-credential-socket\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.075898 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.072223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a26bf91-f389-4522-8d3d-173db5feb1fc-istiod-ca-cert\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.081215 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.081196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-podinfo\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.082891 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.082867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-token\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.084826 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.084434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx5ft\" (UniqueName: \"kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-kube-api-access-kx5ft\") pod \"e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") " pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.202860 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.202771    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:19.224850 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.224817    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 00:10:19.225123 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.225086    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 00:10:19.360957 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.355332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:19.510638 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.510537    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"]
Sep 10 00:10:19.514204 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:10:19.514178    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a26bf91_f389_4522_8d3d_173db5feb1fc.slice/crio-d875022e6d765ee40356858644a61f29836fd3a095a622b40950f31f6a41d2ea WatchSource:0}: Error finding container d875022e6d765ee40356858644a61f29836fd3a095a622b40950f31f6a41d2ea: Status 404 returned error can't find the container with id d875022e6d765ee40356858644a61f29836fd3a095a622b40950f31f6a41d2ea
Sep 10 00:10:19.517837 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.517793    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:19.518031 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.518013    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:19.524374 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.518241    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:19.726042 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.725999    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" event={"ID":"6a26bf91-f389-4522-8d3d-173db5feb1fc","Type":"ContainerStarted","Data":"7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b"}
Sep 10 00:10:19.726221 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.726100    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" event={"ID":"6a26bf91-f389-4522-8d3d-173db5feb1fc","Type":"ContainerStarted","Data":"d875022e6d765ee40356858644a61f29836fd3a095a622b40950f31f6a41d2ea"}
Sep 10 00:10:19.745603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:19.745538    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" podStartSLOduration=1.74551728 podStartE2EDuration="1.74551728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:10:19.742631811 +0000 UTC m=+1293.874759039" watchObservedRunningTime="2026-09-10 00:10:19.74551728 +0000 UTC m=+1293.877644509"
Sep 10 00:10:20.012234 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:20.012197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:20.203811 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:20.203775    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:20.204901 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:20.204879    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 10 00:10:20.204977 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:20.204927    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 10 00:10:20.224944 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:20.224915    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 00:10:20.225072 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:20.224979    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 00:10:20.957561 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:20.957526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:21.208266 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:21.208185    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:21.228887 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:21.228856    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:10:21.229181 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:21.229158    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:10:21.229846 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:21.229824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:10:21.624466 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:21.624434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:21.725681 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:21.725650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:21.738700 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:21.738671    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:21.739450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:21.739430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:22.749710 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.749678    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"]
Sep 10 00:10:22.753302 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.753278    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.755662 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.755639    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-870d44-serving-cert\""
Sep 10 00:10:22.763404 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.763380    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"]
Sep 10 00:10:22.812721 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.812677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l86n\" (UniqueName: \"kubernetes.io/projected/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-kube-api-access-4l86n\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.812911 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.812750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.812911 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.812789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.813082 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.812958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.818873 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.818850    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:22.914445 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.914406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l86n\" (UniqueName: \"kubernetes.io/projected/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-kube-api-access-4l86n\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.914654 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.914454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.914654 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.914485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.914654 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.914528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.914654 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:22.914643    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-serving-cert: secret "maas-api-e2e-shared-b-w2-870d44-serving-cert" not found
Sep 10 00:10:22.914881 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:22.914712    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-maas-api-tls podName:0a9c5fd1-7ab0-412d-a18a-e41398e81e1d nodeName:}" failed. No retries permitted until 2026-09-10 00:10:23.414689625 +0000 UTC m=+1297.546816836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-maas-api-tls") pod "maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr" (UID: "0a9c5fd1-7ab0-412d-a18a-e41398e81e1d") : secret "maas-api-e2e-shared-b-w2-870d44-serving-cert" not found
Sep 10 00:10:22.915249 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.915229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.917042 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.917016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:22.919670 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.919648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:22.923400 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:22.923381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l86n\" (UniqueName: \"kubernetes.io/projected/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-kube-api-access-4l86n\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:23.322772 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:23.322708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:23.420862 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:23.420762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:23.423476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:23.423448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:23.431485 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:23.431462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:23.610951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:23.610851    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:23.667904 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:23.667868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:23.710948 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:23.710898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:23.789892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:23.789854    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:23.845873 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:23.845839    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:23.949065 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:23.949026    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"]
Sep 10 00:10:23.950577 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:10:23.950546    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9c5fd1_7ab0_412d_a18a_e41398e81e1d.slice/crio-01d1656c34864fbdd24ed732146124625752d8bb3bbe427e75407db756d37fb5 WatchSource:0}: Error finding container 01d1656c34864fbdd24ed732146124625752d8bb3bbe427e75407db756d37fb5: Status 404 returned error can't find the container with id 01d1656c34864fbdd24ed732146124625752d8bb3bbe427e75407db756d37fb5
Sep 10 00:10:24.145516 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:24.145469    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:24.761729 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:24.761695    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr" event={"ID":"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d","Type":"ContainerStarted","Data":"4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d"}
Sep 10 00:10:24.761896 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:24.761747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr" event={"ID":"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d","Type":"ContainerStarted","Data":"01d1656c34864fbdd24ed732146124625752d8bb3bbe427e75407db756d37fb5"}
Sep 10 00:10:24.761896 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:24.761846    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:24.782729 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:24.782620    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr" podStartSLOduration=2.214300691 podStartE2EDuration="2.782603245s" totalImagesPullingTime="568.302554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:10:24.780468966 +0000 UTC m=+1298.912596212" watchObservedRunningTime="2026-09-10 00:10:24.782603245 +0000 UTC m=+1298.914730527"
Sep 10 00:10:29.934191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:29.934155    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:30.034878 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:30.034843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:30.157989 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:30.157952    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"]
Sep 10 00:10:30.158267 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:30.158236    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy" containerID="cri-o://5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee" gracePeriod=30
Sep 10 00:10:30.184475 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:30.184390    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:30.629751 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:30.629712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:30.774250 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:30.774221    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:10:34.611143 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:34.611099    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 00:10:34.611515 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:34.611157    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 00:10:35.424632 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.424564    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:10:35.542719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.542691    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-envoy\") pod \"9ae95fe6-7411-47bc-9525-5f19f6280a03\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") "
Sep 10 00:10:35.542719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.542722    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-credential-socket\") pod \"9ae95fe6-7411-47bc-9525-5f19f6280a03\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") "
Sep 10 00:10:35.542925 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.542753    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-certs\") pod \"9ae95fe6-7411-47bc-9525-5f19f6280a03\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") "
Sep 10 00:10:35.542925 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.542788    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-podinfo\") pod \"9ae95fe6-7411-47bc-9525-5f19f6280a03\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") "
Sep 10 00:10:35.542925 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.542831    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbfr9\" (UniqueName: \"kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-kube-api-access-pbfr9\") pod \"9ae95fe6-7411-47bc-9525-5f19f6280a03\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") "
Sep 10 00:10:35.542925 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.542860    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-token\") pod \"9ae95fe6-7411-47bc-9525-5f19f6280a03\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") "
Sep 10 00:10:35.543224 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543048    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ae95fe6-7411-47bc-9525-5f19f6280a03-istiod-ca-cert\") pod \"9ae95fe6-7411-47bc-9525-5f19f6280a03\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") "
Sep 10 00:10:35.543224 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543059    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ae95fe6-7411-47bc-9525-5f19f6280a03" (UID: "9ae95fe6-7411-47bc-9525-5f19f6280a03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:35.543224 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543103    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-data\") pod \"9ae95fe6-7411-47bc-9525-5f19f6280a03\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") "
Sep 10 00:10:35.543224 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543132    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-socket\") pod \"9ae95fe6-7411-47bc-9525-5f19f6280a03\" (UID: \"9ae95fe6-7411-47bc-9525-5f19f6280a03\") "
Sep 10 00:10:35.543451 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543324    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ae95fe6-7411-47bc-9525-5f19f6280a03" (UID: "9ae95fe6-7411-47bc-9525-5f19f6280a03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:35.543451 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543389    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ae95fe6-7411-47bc-9525-5f19f6280a03-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ae95fe6-7411-47bc-9525-5f19f6280a03" (UID: "9ae95fe6-7411-47bc-9525-5f19f6280a03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:10:35.543560 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543531    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ae95fe6-7411-47bc-9525-5f19f6280a03" (UID: "9ae95fe6-7411-47bc-9525-5f19f6280a03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:35.543623 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543604    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:35.543685 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543626    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:35.543685 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543641    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ae95fe6-7411-47bc-9525-5f19f6280a03-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:35.543786 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.543703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ae95fe6-7411-47bc-9525-5f19f6280a03" (UID: "9ae95fe6-7411-47bc-9525-5f19f6280a03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:35.545161 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.545133    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-kube-api-access-pbfr9" (OuterVolumeSpecName: "kube-api-access-pbfr9") pod "9ae95fe6-7411-47bc-9525-5f19f6280a03" (UID: "9ae95fe6-7411-47bc-9525-5f19f6280a03"). InnerVolumeSpecName "kube-api-access-pbfr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:10:35.545295 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.545181    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ae95fe6-7411-47bc-9525-5f19f6280a03" (UID: "9ae95fe6-7411-47bc-9525-5f19f6280a03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:10:35.545295 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.545245    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ae95fe6-7411-47bc-9525-5f19f6280a03" (UID: "9ae95fe6-7411-47bc-9525-5f19f6280a03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:35.545569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.545537    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ae95fe6-7411-47bc-9525-5f19f6280a03" (UID: "9ae95fe6-7411-47bc-9525-5f19f6280a03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:10:35.644892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.644853    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:35.644892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.644891    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:35.645314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.644905    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ae95fe6-7411-47bc-9525-5f19f6280a03-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:35.645314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.644918    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:35.645314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.644962    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbfr9\" (UniqueName: \"kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-kube-api-access-pbfr9\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:35.645314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.644977    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ae95fe6-7411-47bc-9525-5f19f6280a03-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:35.826818 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.826787    2560 generic.go:356] "Generic (PLEG): container finished" podID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerID="5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee" exitCode=0
Sep 10 00:10:35.827015 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.826829    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" event={"ID":"9ae95fe6-7411-47bc-9525-5f19f6280a03","Type":"ContainerDied","Data":"5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee"}
Sep 10 00:10:35.827015 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.826842    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"
Sep 10 00:10:35.827015 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.826871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p" event={"ID":"9ae95fe6-7411-47bc-9525-5f19f6280a03","Type":"ContainerDied","Data":"aa59e8bf41f676964d5ad4b60f5d74a5950ed0456567efe02ef866f501b08aab"}
Sep 10 00:10:35.827015 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.826894    2560 scope.go:117] "RemoveContainer" containerID="5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee"
Sep 10 00:10:35.837124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.837102    2560 scope.go:117] "RemoveContainer" containerID="bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296"
Sep 10 00:10:35.846294 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.846271    2560 scope.go:117] "RemoveContainer" containerID="5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee"
Sep 10 00:10:35.846908 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:35.846769    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee\": container with ID starting with 5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee not found: ID does not exist" containerID="5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee"
Sep 10 00:10:35.846908 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.846810    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee"} err="failed to get container status \"5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee\": rpc error: code = NotFound desc = could not find container \"5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee\": container with ID starting with 5772b2e6de84f6a84213b6f39dff4d23366159b7fbf8412a3c171710baaea1ee not found: ID does not exist"
Sep 10 00:10:35.846908 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.846835    2560 scope.go:117] "RemoveContainer" containerID="bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296"
Sep 10 00:10:35.847846 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:35.847818    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296\": container with ID starting with bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296 not found: ID does not exist" containerID="bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296"
Sep 10 00:10:35.848320 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.847855    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296"} err="failed to get container status \"bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296\": rpc error: code = NotFound desc = could not find container \"bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296\": container with ID starting with bb9d87a41e9a9902af4591485b9d2b4a2196868f07e352e1be09ca2837084296 not found: ID does not exist"
Sep 10 00:10:35.849851 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.849826    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"]
Sep 10 00:10:35.855123 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:35.855100    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p"]
Sep 10 00:10:36.340430 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:36.340399    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" path="/var/lib/kubelet/pods/9ae95fe6-7411-47bc-9525-5f19f6280a03/volumes"
Sep 10 00:10:40.944896 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:40.944837    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:41.003907 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:41.003875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:41.063493 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:41.063458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:41.142878 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:41.142837    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:41.204593 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:41.204524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:41.497907 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:41.497814    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:43.707040 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:43.707003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:43.808154 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:43.808116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:44.412818 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:44.412785    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:10:46.419575 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:46.419545    2560 scope.go:117] "RemoveContainer" containerID="e6c524782aade5e8cadcab3eaf4011677e6c9a2f9743a84655544bf6fe370576"
Sep 10 00:10:46.551732 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:46.551697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:47.218411 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.218339    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:47.273446 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.273409    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7789-42c796"]
Sep 10 00:10:47.274149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.274120    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy"
Sep 10 00:10:47.274149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.274148    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy"
Sep 10 00:10:47.274314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.274181    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy"
Sep 10 00:10:47.274314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.274190    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy"
Sep 10 00:10:47.274314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.274278    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy"
Sep 10 00:10:47.274314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.274291    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae95fe6-7411-47bc-9525-5f19f6280a03" containerName="istio-proxy"
Sep 10 00:10:47.279117 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.279090    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7789-42c796"
Sep 10 00:10:47.280955 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.280914    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7789-42c796"]
Sep 10 00:10:47.282515 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.282494    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gtwx5\""
Sep 10 00:10:47.296219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.296186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:47.375838 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.375797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf9sw\" (UniqueName: \"kubernetes.io/projected/2ef6964f-c186-4a52-848f-bb388775318f-kube-api-access-lf9sw\") pod \"test-curl-7789-42c796\" (UID: \"2ef6964f-c186-4a52-848f-bb388775318f\") " pod="opendatahub/test-curl-7789-42c796"
Sep 10 00:10:47.443174 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.443135    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"]
Sep 10 00:10:47.443602 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.443395    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy" containerID="cri-o://412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2" gracePeriod=30
Sep 10 00:10:47.472306 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.472199    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:47.477551 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.477522    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf9sw\" (UniqueName: \"kubernetes.io/projected/2ef6964f-c186-4a52-848f-bb388775318f-kube-api-access-lf9sw\") pod \"test-curl-7789-42c796\" (UID: \"2ef6964f-c186-4a52-848f-bb388775318f\") " pod="opendatahub/test-curl-7789-42c796"
Sep 10 00:10:47.485298 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.485267    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf9sw\" (UniqueName: \"kubernetes.io/projected/2ef6964f-c186-4a52-848f-bb388775318f-kube-api-access-lf9sw\") pod \"test-curl-7789-42c796\" (UID: \"2ef6964f-c186-4a52-848f-bb388775318f\") " pod="opendatahub/test-curl-7789-42c796"
Sep 10 00:10:47.593164 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.593131    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7789-42c796"
Sep 10 00:10:47.896344 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:47.896320    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7789-42c796"]
Sep 10 00:10:47.898101 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:10:47.898075    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ef6964f_c186_4a52_848f_bb388775318f.slice/crio-d73cee2ef474baa867d3fabb68d3be6fbfb04e3e1607b23f8318b0220e35585b WatchSource:0}: Error finding container d73cee2ef474baa867d3fabb68d3be6fbfb04e3e1607b23f8318b0220e35585b: Status 404 returned error can't find the container with id d73cee2ef474baa867d3fabb68d3be6fbfb04e3e1607b23f8318b0220e35585b
Sep 10 00:10:48.033522 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.033486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:48.264241 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.264145    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"]
Sep 10 00:10:48.283272 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.282577    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.286399 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.286117    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-1de9a7-openshift-default-dockercfg-7q7s9\""
Sep 10 00:10:48.287578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.287552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:48.289904 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.289869    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"]
Sep 10 00:10:48.389706 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.389522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istiod-ca-cert\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.389706 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.389595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-token\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.389706 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.389648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-credential-socket\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.389706 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.389681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-podinfo\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.390114 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.389746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-data\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.390114 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.389790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-socket\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.390114 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.389819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-envoy\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.390114 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.389865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldm9l\" (UniqueName: \"kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-kube-api-access-ldm9l\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.390114 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.389895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-certs\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.490733 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.490697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istiod-ca-cert\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.490749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-token\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.490791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-credential-socket\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.490813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-podinfo\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.490859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-data\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.490902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-socket\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.490943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-envoy\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.490987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldm9l\" (UniqueName: \"kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-kube-api-access-ldm9l\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.491016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-certs\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491467 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.491235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-credential-socket\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491467 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.491325    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istiod-ca-cert\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491467 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.491372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-certs\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491579 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.491475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-socket\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.491579 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.491510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-data\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.493543 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.493517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-envoy\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.493871 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.493853    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-podinfo\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.502072 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.502051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldm9l\" (UniqueName: \"kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-kube-api-access-ldm9l\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.502234 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.502209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-token\") pod \"e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") " pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.517304 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.517245    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:48.598489 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.598453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:48.896872 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.896846    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"]
Sep 10 00:10:48.898271 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:10:48.898240    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8b3677_d98a_41fe_86b2_d0bbab81dbd6.slice/crio-2e47b2c675235302a8bf7757a8b7e8e5c094e96a6ea061f95ea4bdfee5715e0f WatchSource:0}: Error finding container 2e47b2c675235302a8bf7757a8b7e8e5c094e96a6ea061f95ea4bdfee5715e0f: Status 404 returned error can't find the container with id 2e47b2c675235302a8bf7757a8b7e8e5c094e96a6ea061f95ea4bdfee5715e0f
Sep 10 00:10:48.900659 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.900628    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:48.900735 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.900690    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:48.900735 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.900717    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:48.908426 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.908402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" event={"ID":"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6","Type":"ContainerStarted","Data":"2e47b2c675235302a8bf7757a8b7e8e5c094e96a6ea061f95ea4bdfee5715e0f"}
Sep 10 00:10:48.910159 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.910138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7789-42c796" event={"ID":"2ef6964f-c186-4a52-848f-bb388775318f","Type":"ContainerStarted","Data":"50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91"}
Sep 10 00:10:48.910259 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.910167    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7789-42c796" event={"ID":"2ef6964f-c186-4a52-848f-bb388775318f","Type":"ContainerStarted","Data":"d73cee2ef474baa867d3fabb68d3be6fbfb04e3e1607b23f8318b0220e35585b"}
Sep 10 00:10:48.924420 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:48.924372    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7789-42c796" podStartSLOduration=1.9243588630000001 podStartE2EDuration="1.924358863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:10:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:10:48.92352678 +0000 UTC m=+1323.055654009" watchObservedRunningTime="2026-09-10 00:10:48.924358863 +0000 UTC m=+1323.056486092"
Sep 10 00:10:49.555196 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.555146    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7789-42c796"]
Sep 10 00:10:49.558330 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.558296    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7789-42c796"]
Sep 10 00:10:49.670129 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.670027    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7789-9f7fc8"]
Sep 10 00:10:49.670728 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.670703    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef6964f-c186-4a52-848f-bb388775318f" containerName="test-curl-7789-42c796"
Sep 10 00:10:49.670817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.670732    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef6964f-c186-4a52-848f-bb388775318f" containerName="test-curl-7789-42c796"
Sep 10 00:10:49.670877 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.670836    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef6964f-c186-4a52-848f-bb388775318f" containerName="test-curl-7789-42c796"
Sep 10 00:10:49.674526 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.674500    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7789-9f7fc8"
Sep 10 00:10:49.677168 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.677143    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7789-9f7fc8"]
Sep 10 00:10:49.701635 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.701606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qtpb\" (UniqueName: \"kubernetes.io/projected/5323ba8f-00bf-446e-bd88-1312b2d1429c-kube-api-access-9qtpb\") pod \"test-curl-7789-9f7fc8\" (UID: \"5323ba8f-00bf-446e-bd88-1312b2d1429c\") " pod="opendatahub/test-curl-7789-9f7fc8"
Sep 10 00:10:49.802576 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.802527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qtpb\" (UniqueName: \"kubernetes.io/projected/5323ba8f-00bf-446e-bd88-1312b2d1429c-kube-api-access-9qtpb\") pod \"test-curl-7789-9f7fc8\" (UID: \"5323ba8f-00bf-446e-bd88-1312b2d1429c\") " pod="opendatahub/test-curl-7789-9f7fc8"
Sep 10 00:10:49.810507 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.810472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qtpb\" (UniqueName: \"kubernetes.io/projected/5323ba8f-00bf-446e-bd88-1312b2d1429c-kube-api-access-9qtpb\") pod \"test-curl-7789-9f7fc8\" (UID: \"5323ba8f-00bf-446e-bd88-1312b2d1429c\") " pod="opendatahub/test-curl-7789-9f7fc8"
Sep 10 00:10:49.918340 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.918309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" event={"ID":"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6","Type":"ContainerStarted","Data":"7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb"}
Sep 10 00:10:49.918519 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:49.918501    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7789-42c796" container="test-curl-7789-42c796"
Sep 10 00:10:49.938347 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.938232    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" podStartSLOduration=1.938213221 podStartE2EDuration="1.938213221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:10:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:10:49.936620528 +0000 UTC m=+1324.068747780" watchObservedRunningTime="2026-09-10 00:10:49.938213221 +0000 UTC m=+1324.070340450"
Sep 10 00:10:49.985942 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:49.985895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7789-9f7fc8"
Sep 10 00:10:50.264006 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.260948    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7789-9f7fc8"]
Sep 10 00:10:50.274984 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:10:50.274924    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5323ba8f_00bf_446e_bd88_1312b2d1429c.slice/crio-99482927f182ff69028da0cf475c1e69271b5fef4a91033077e2295dd8890386 WatchSource:0}: Error finding container 99482927f182ff69028da0cf475c1e69271b5fef4a91033077e2295dd8890386: Status 404 returned error can't find the container with id 99482927f182ff69028da0cf475c1e69271b5fef4a91033077e2295dd8890386
Sep 10 00:10:50.598640 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.598606    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:50.603595 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.603571    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:50.926306 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.926216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7789-9f7fc8" event={"ID":"5323ba8f-00bf-446e-bd88-1312b2d1429c","Type":"ContainerStarted","Data":"53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b"}
Sep 10 00:10:50.926306 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.926267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7789-9f7fc8" event={"ID":"5323ba8f-00bf-446e-bd88-1312b2d1429c","Type":"ContainerStarted","Data":"99482927f182ff69028da0cf475c1e69271b5fef4a91033077e2295dd8890386"}
Sep 10 00:10:50.926547 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.926528    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:50.926614 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.926522    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7789-42c796" podUID="2ef6964f-c186-4a52-848f-bb388775318f" containerName="test-curl-7789-42c796" containerID="cri-o://50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91" gracePeriod=2
Sep 10 00:10:50.927569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.927550    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:10:50.940194 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.940156    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7789-9f7fc8" podStartSLOduration=1.9401441099999999 podStartE2EDuration="1.94014411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:10:50.939971016 +0000 UTC m=+1325.072098245" watchObservedRunningTime="2026-09-10 00:10:50.94014411 +0000 UTC m=+1325.072271337"
Sep 10 00:10:50.996253 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.996212    2560 patch_prober.go:28] interesting pod/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 00:10:50.996440 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:50.996287    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 00:10:51.551966 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:51.551907    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7789-9f7fc8"]
Sep 10 00:10:51.555537 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:51.555506    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7789-9f7fc8"]
Sep 10 00:10:51.854946 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:51.854912    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:51.932752 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:51.932719    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7789-9f7fc8" container="test-curl-7789-9f7fc8"
Sep 10 00:10:51.954145 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:51.954091    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:52.669526 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.669473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:52.722678 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.722611    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:10:52.781184 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.781139    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 00:10:52.781357 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.781218    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 00:10:52.833570 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.833530    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-socket\") pod \"2741b33b-e20a-4b9d-8852-ab64f9f77515\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") "
Sep 10 00:10:52.833739 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.833625    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-credential-socket\") pod \"2741b33b-e20a-4b9d-8852-ab64f9f77515\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") "
Sep 10 00:10:52.833739 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.833683    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2741b33b-e20a-4b9d-8852-ab64f9f77515-istiod-ca-cert\") pod \"2741b33b-e20a-4b9d-8852-ab64f9f77515\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") "
Sep 10 00:10:52.833739 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.833718    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-certs\") pod \"2741b33b-e20a-4b9d-8852-ab64f9f77515\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") "
Sep 10 00:10:52.833901 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.833745    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-token\") pod \"2741b33b-e20a-4b9d-8852-ab64f9f77515\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") "
Sep 10 00:10:52.833901 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.833774    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggkjj\" (UniqueName: \"kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-kube-api-access-ggkjj\") pod \"2741b33b-e20a-4b9d-8852-ab64f9f77515\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") "
Sep 10 00:10:52.833901 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.833842    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-envoy\") pod \"2741b33b-e20a-4b9d-8852-ab64f9f77515\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") "
Sep 10 00:10:52.833901 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.833851    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2741b33b-e20a-4b9d-8852-ab64f9f77515" (UID: "2741b33b-e20a-4b9d-8852-ab64f9f77515"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:52.834163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.833962    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-data\") pod \"2741b33b-e20a-4b9d-8852-ab64f9f77515\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") "
Sep 10 00:10:52.834163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.833977    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2741b33b-e20a-4b9d-8852-ab64f9f77515" (UID: "2741b33b-e20a-4b9d-8852-ab64f9f77515"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:52.834163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.834008    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-podinfo\") pod \"2741b33b-e20a-4b9d-8852-ab64f9f77515\" (UID: \"2741b33b-e20a-4b9d-8852-ab64f9f77515\") "
Sep 10 00:10:52.834163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.834126    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2741b33b-e20a-4b9d-8852-ab64f9f77515-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2741b33b-e20a-4b9d-8852-ab64f9f77515" (UID: "2741b33b-e20a-4b9d-8852-ab64f9f77515"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:10:52.834394 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.834264    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-data" (OuterVolumeSpecName: "istio-data") pod "2741b33b-e20a-4b9d-8852-ab64f9f77515" (UID: "2741b33b-e20a-4b9d-8852-ab64f9f77515"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:52.834578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.834555    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:52.834662 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.834581    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2741b33b-e20a-4b9d-8852-ab64f9f77515-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:52.834662 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.834595    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:52.834662 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.834609    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:52.834835 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.834764    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2741b33b-e20a-4b9d-8852-ab64f9f77515" (UID: "2741b33b-e20a-4b9d-8852-ab64f9f77515"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:52.836309 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.836273    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-token" (OuterVolumeSpecName: "istio-token") pod "2741b33b-e20a-4b9d-8852-ab64f9f77515" (UID: "2741b33b-e20a-4b9d-8852-ab64f9f77515"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:10:52.836309 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.836289    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2741b33b-e20a-4b9d-8852-ab64f9f77515" (UID: "2741b33b-e20a-4b9d-8852-ab64f9f77515"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:10:52.836603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.836584    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2741b33b-e20a-4b9d-8852-ab64f9f77515" (UID: "2741b33b-e20a-4b9d-8852-ab64f9f77515"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:10:52.836603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.836593    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-kube-api-access-ggkjj" (OuterVolumeSpecName: "kube-api-access-ggkjj") pod "2741b33b-e20a-4b9d-8852-ab64f9f77515" (UID: "2741b33b-e20a-4b9d-8852-ab64f9f77515"). InnerVolumeSpecName "kube-api-access-ggkjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:10:52.908151 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.908114    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"]
Sep 10 00:10:52.908698 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.908683    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy"
Sep 10 00:10:52.908743 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.908701    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy"
Sep 10 00:10:52.908743 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.908717    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy"
Sep 10 00:10:52.908743 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.908726    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy"
Sep 10 00:10:52.908880 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.908762    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5323ba8f-00bf-446e-bd88-1312b2d1429c" containerName="test-curl-7789-9f7fc8"
Sep 10 00:10:52.908880 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.908771    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5323ba8f-00bf-446e-bd88-1312b2d1429c" containerName="test-curl-7789-9f7fc8"
Sep 10 00:10:52.908958 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.908880    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy"
Sep 10 00:10:52.908958 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.908892    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5323ba8f-00bf-446e-bd88-1312b2d1429c" containerName="test-curl-7789-9f7fc8"
Sep 10 00:10:52.912710 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.912691    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:52.915195 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.915171    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-1de9a7-serving-cert\""
Sep 10 00:10:52.920165 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.920060    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"]
Sep 10 00:10:52.936056 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.935810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppjck\" (UniqueName: \"kubernetes.io/projected/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-kube-api-access-ppjck\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:52.936056 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.935895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:52.936056 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.936049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:52.936261 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.936082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:52.936261 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.936232    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:52.936261 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.936250    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:52.936403 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.936262    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2741b33b-e20a-4b9d-8852-ab64f9f77515-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:52.936403 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.936274    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:52.936403 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.936287    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggkjj\" (UniqueName: \"kubernetes.io/projected/2741b33b-e20a-4b9d-8852-ab64f9f77515-kube-api-access-ggkjj\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:52.942819 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.942792    2560 generic.go:356] "Generic (PLEG): container finished" podID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerID="412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2" exitCode=0
Sep 10 00:10:52.942943 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.942842    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"
Sep 10 00:10:52.942943 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.942878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" event={"ID":"2741b33b-e20a-4b9d-8852-ab64f9f77515","Type":"ContainerDied","Data":"412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2"}
Sep 10 00:10:52.943047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.942961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4" event={"ID":"2741b33b-e20a-4b9d-8852-ab64f9f77515","Type":"ContainerDied","Data":"f3eff0320c969bed0f472522e5c4d99e9d843bd54cb86f034290fb22e786cac5"}
Sep 10 00:10:52.943047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.942996    2560 scope.go:117] "RemoveContainer" containerID="412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2"
Sep 10 00:10:52.943345 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.943287    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7789-9f7fc8" podUID="5323ba8f-00bf-446e-bd88-1312b2d1429c" containerName="test-curl-7789-9f7fc8" containerID="cri-o://53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b" gracePeriod=2
Sep 10 00:10:52.990007 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:52.989985    2560 scope.go:117] "RemoveContainer" containerID="28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4"
Sep 10 00:10:53.004657 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.004334    2560 scope.go:117] "RemoveContainer" containerID="412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2"
Sep 10 00:10:53.004788 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.004599    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"]
Sep 10 00:10:53.005335 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:53.005307    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2\": container with ID starting with 412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2 not found: ID does not exist" containerID="412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2"
Sep 10 00:10:53.005441 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.005344    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2"} err="failed to get container status \"412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2\": rpc error: code = NotFound desc = could not find container \"412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2\": container with ID starting with 412eb25872aa75002438300c080327ca05e5027949cd4a8dab0a7a8d9e492ee2 not found: ID does not exist"
Sep 10 00:10:53.005441 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.005366    2560 scope.go:117] "RemoveContainer" containerID="28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4"
Sep 10 00:10:53.005759 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:53.005735    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4\": container with ID starting with 28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4 not found: ID does not exist" containerID="28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4"
Sep 10 00:10:53.005839 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.005763    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4"} err="failed to get container status \"28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4\": rpc error: code = NotFound desc = could not find container \"28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4\": container with ID starting with 28367bd2c71904084edbc49d64b488b0214f605261acd4d240eff459feee7fd4 not found: ID does not exist"
Sep 10 00:10:53.010791 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.010765    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4"]
Sep 10 00:10:53.011902 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.011873    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:53.037046 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.037013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppjck\" (UniqueName: \"kubernetes.io/projected/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-kube-api-access-ppjck\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:53.037222 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.037108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:53.037222 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.037212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:53.037357 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.037243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:53.037661 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:53.037555    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-serving-cert: secret "maas-api-e2e-shared-a-w3-1de9a7-serving-cert" not found
Sep 10 00:10:53.037661 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:53.037618    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls podName:c70ab0ff-7d56-4431-a4c5-fc8cce20b73a nodeName:}" failed. No retries permitted until 2026-09-10 00:10:53.537597654 +0000 UTC m=+1327.669724873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls") pod "maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9" (UID: "c70ab0ff-7d56-4431-a4c5-fc8cce20b73a") : secret "maas-api-e2e-shared-a-w3-1de9a7-serving-cert" not found
Sep 10 00:10:53.038130 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.038111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:53.040153 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.040131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:53.048140 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.048117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppjck\" (UniqueName: \"kubernetes.io/projected/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-kube-api-access-ppjck\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:53.112707 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.112657    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:53.131958 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.131922    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7789-42c796"
Sep 10 00:10:53.238767 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.238693    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf9sw\" (UniqueName: \"kubernetes.io/projected/2ef6964f-c186-4a52-848f-bb388775318f-kube-api-access-lf9sw\") pod \"2ef6964f-c186-4a52-848f-bb388775318f\" (UID: \"2ef6964f-c186-4a52-848f-bb388775318f\") "
Sep 10 00:10:53.240775 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.240755    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef6964f-c186-4a52-848f-bb388775318f-kube-api-access-lf9sw" (OuterVolumeSpecName: "kube-api-access-lf9sw") pod "2ef6964f-c186-4a52-848f-bb388775318f" (UID: "2ef6964f-c186-4a52-848f-bb388775318f"). InnerVolumeSpecName "kube-api-access-lf9sw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:10:53.340411 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.340379    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf9sw\" (UniqueName: \"kubernetes.io/projected/2ef6964f-c186-4a52-848f-bb388775318f-kube-api-access-lf9sw\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:53.487634 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.487581    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:53.542015 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.541940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:53.542147 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:53.542067    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-serving-cert: secret "maas-api-e2e-shared-a-w3-1de9a7-serving-cert" not found
Sep 10 00:10:53.542292 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:53.542146    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls podName:c70ab0ff-7d56-4431-a4c5-fc8cce20b73a nodeName:}" failed. No retries permitted until 2026-09-10 00:10:54.542115439 +0000 UTC m=+1328.674242645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls") pod "maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9" (UID: "c70ab0ff-7d56-4431-a4c5-fc8cce20b73a") : secret "maas-api-e2e-shared-a-w3-1de9a7-serving-cert" not found
Sep 10 00:10:53.577328 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.577293    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:53.952076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.952044    2560 generic.go:356] "Generic (PLEG): container finished" podID="2ef6964f-c186-4a52-848f-bb388775318f" containerID="50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91" exitCode=137
Sep 10 00:10:53.952484 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.952117    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7789-42c796"
Sep 10 00:10:53.952484 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.952122    2560 scope.go:117] "RemoveContainer" containerID="50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91"
Sep 10 00:10:53.961166 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.961145    2560 scope.go:117] "RemoveContainer" containerID="50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91"
Sep 10 00:10:53.961492 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:53.961461    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91\": container with ID starting with 50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91 not found: ID does not exist" containerID="50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91"
Sep 10 00:10:53.961558 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:53.961501    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91"} err="failed to get container status \"50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91\": rpc error: code = NotFound desc = could not find container \"50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91\": container with ID starting with 50e1bac5d641da90b2d5bcc77f3325e09568125b210f4d4ae1ec645cb1698e91 not found: ID does not exist"
Sep 10 00:10:53.966078 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:53.966054    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7789-42c796\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="2ef6964f-c186-4a52-848f-bb388775318f" pod="opendatahub/test-curl-7789-42c796"
Sep 10 00:10:54.020755 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.020730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:54.341927 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.341891    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" path="/var/lib/kubelet/pods/2741b33b-e20a-4b9d-8852-ab64f9f77515/volumes"
Sep 10 00:10:54.342308 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.342293    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ef6964f-c186-4a52-848f-bb388775318f" path="/var/lib/kubelet/pods/2ef6964f-c186-4a52-848f-bb388775318f/volumes"
Sep 10 00:10:54.554041 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.554004    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:54.556426 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.556399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:54.726115 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.726082    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:54.961452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.961418    2560 generic.go:356] "Generic (PLEG): container finished" podID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerID="7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b" exitCode=0
Sep 10 00:10:54.961786 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.961456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" event={"ID":"6a26bf91-f389-4522-8d3d-173db5feb1fc","Type":"ContainerDied","Data":"7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b"}
Sep 10 00:10:54.961871 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.961857    2560 scope.go:117] "RemoveContainer" containerID="7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b"
Sep 10 00:10:54.968970 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.963427    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:54.968970 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.963594    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:54.968970 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:54.963689    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:55.002466 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.002422    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"]
Sep 10 00:10:55.007306 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:10:55.007278    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70ab0ff_7d56_4431_a4c5_fc8cce20b73a.slice/crio-baf022b5a3e8469d5eb7df27721186fd26e15937631be391a6626dd771dc9959 WatchSource:0}: Error finding container baf022b5a3e8469d5eb7df27721186fd26e15937631be391a6626dd771dc9959: Status 404 returned error can't find the container with id baf022b5a3e8469d5eb7df27721186fd26e15937631be391a6626dd771dc9959
Sep 10 00:10:55.144690 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.144663    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7789-9f7fc8"
Sep 10 00:10:55.261791 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.261701    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qtpb\" (UniqueName: \"kubernetes.io/projected/5323ba8f-00bf-446e-bd88-1312b2d1429c-kube-api-access-9qtpb\") pod \"5323ba8f-00bf-446e-bd88-1312b2d1429c\" (UID: \"5323ba8f-00bf-446e-bd88-1312b2d1429c\") "
Sep 10 00:10:55.264034 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.264009    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5323ba8f-00bf-446e-bd88-1312b2d1429c-kube-api-access-9qtpb" (OuterVolumeSpecName: "kube-api-access-9qtpb") pod "5323ba8f-00bf-446e-bd88-1312b2d1429c" (UID: "5323ba8f-00bf-446e-bd88-1312b2d1429c"). InnerVolumeSpecName "kube-api-access-9qtpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:10:55.363008 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.362972    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qtpb\" (UniqueName: \"kubernetes.io/projected/5323ba8f-00bf-446e-bd88-1312b2d1429c-kube-api-access-9qtpb\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:10:55.728637 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.728599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:55.972803 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.972755    2560 generic.go:356] "Generic (PLEG): container finished" podID="5323ba8f-00bf-446e-bd88-1312b2d1429c" containerID="53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b" exitCode=137
Sep 10 00:10:55.973349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.972883    2560 scope.go:117] "RemoveContainer" containerID="53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b"
Sep 10 00:10:55.973349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.973050    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7789-9f7fc8"
Sep 10 00:10:55.976821 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.976784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9" event={"ID":"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a","Type":"ContainerStarted","Data":"e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3"}
Sep 10 00:10:55.976969 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.976855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9" event={"ID":"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a","Type":"ContainerStarted","Data":"baf022b5a3e8469d5eb7df27721186fd26e15937631be391a6626dd771dc9959"}
Sep 10 00:10:55.977097 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.977074    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:10:55.979543 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.979519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" event={"ID":"6a26bf91-f389-4522-8d3d-173db5feb1fc","Type":"ContainerStarted","Data":"64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6"}
Sep 10 00:10:55.985442 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.985414    2560 scope.go:117] "RemoveContainer" containerID="53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b"
Sep 10 00:10:55.985958 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:55.985871    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b\": container with ID starting with 53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b not found: ID does not exist" containerID="53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b"
Sep 10 00:10:55.985958 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.985901    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b"} err="failed to get container status \"53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b\": rpc error: code = NotFound desc = could not find container \"53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b\": container with ID starting with 53a96d4127fc749a0855ea161831882871f025dcafc73de52df2635e7562807b not found: ID does not exist"
Sep 10 00:10:55.990106 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.990077    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"]
Sep 10 00:10:55.990815 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.990797    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2741b33b-e20a-4b9d-8852-ab64f9f77515" containerName="istio-proxy"
Sep 10 00:10:55.994035 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.994002    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:55.996468 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:55.996449    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-557790f7-openshift-default-dockercfg-crddv\""
Sep 10 00:10:56.000128 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:56.000095    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7789-9f7fc8\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="5323ba8f-00bf-446e-bd88-1312b2d1429c" pod="opendatahub/test-curl-7789-9f7fc8"
Sep 10 00:10:56.000233 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.000126    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9" podStartSLOduration=3.557739315 podStartE2EDuration="4.000109151s" totalImagesPullingTime="442.369836ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:10:55.998146757 +0000 UTC m=+1330.130273985" watchObservedRunningTime="2026-09-10 00:10:56.000109151 +0000 UTC m=+1330.132236390"
Sep 10 00:10:56.007047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.007015    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"]
Sep 10 00:10:56.033816 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.033785    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:56.071984 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.071923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istiod-ca-cert\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.073718 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.072308    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-data\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.073718 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.072373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-podinfo\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.073718 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.072459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-envoy\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.073718 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.072560    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-token\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.073718 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.072605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-certs\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.073718 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.072669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-socket\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.073718 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.072705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-credential-socket\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.073718 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.072784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tccpz\" (UniqueName: \"kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-kube-api-access-tccpz\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.128086 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.128053    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:56.173713 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.173668    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-envoy\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.174044 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.174022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-token\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.174196 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.174179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-certs\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.174792 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.174768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-socket\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.175011 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.174994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-credential-socket\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.175174 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.175157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tccpz\" (UniqueName: \"kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-kube-api-access-tccpz\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.175309 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.175293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istiod-ca-cert\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.175452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.175437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-data\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.175572 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.175557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-podinfo\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.176401 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.176381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-certs\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.177103 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.177081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-socket\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.177471 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.177450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-credential-socket\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.177791 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.177773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-data\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.177896 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.177815    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istiod-ca-cert\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.180385 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.180338    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-envoy\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.180952 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.180917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-podinfo\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.187386 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.187362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tccpz\" (UniqueName: \"kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-kube-api-access-tccpz\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.187753 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.187735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-token\") pod \"e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") " pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.204285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.203694    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:10:56.204285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.203833    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 10 00:10:56.204285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.203883    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 10 00:10:56.308580 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.308542    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:56.338193 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:10:56.338140    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7789-9f7fc8\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="5323ba8f-00bf-446e-bd88-1312b2d1429c" pod="opendatahub/test-curl-7789-9f7fc8"
Sep 10 00:10:56.341764 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.341734    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5323ba8f-00bf-446e-bd88-1312b2d1429c" path="/var/lib/kubelet/pods/5323ba8f-00bf-446e-bd88-1312b2d1429c/volumes"
Sep 10 00:10:56.609278 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.609252    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"]
Sep 10 00:10:56.611258 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:10:56.611231    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b11bc3_b8ae_4b8e_bfbf_ceeead3448ba.slice/crio-99672e741a2a1ce106ae4d9c30e6a371c3eae36c33ce1bcaa8257d31ec403106 WatchSource:0}: Error finding container 99672e741a2a1ce106ae4d9c30e6a371c3eae36c33ce1bcaa8257d31ec403106: Status 404 returned error can't find the container with id 99672e741a2a1ce106ae4d9c30e6a371c3eae36c33ce1bcaa8257d31ec403106
Sep 10 00:10:56.614118 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.614076    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:56.614363 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.614184    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:56.614363 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.614232    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:10:56.989415 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.989305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" event={"ID":"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba","Type":"ContainerStarted","Data":"7c24d1118ebcae1a347cfda5f34ae7fabe9bc3834cc1a874486b5ac3993d737e"}
Sep 10 00:10:56.989415 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:56.989393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" event={"ID":"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba","Type":"ContainerStarted","Data":"99672e741a2a1ce106ae4d9c30e6a371c3eae36c33ce1bcaa8257d31ec403106"}
Sep 10 00:10:57.009837 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:57.009777    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" podStartSLOduration=2.009762246 podStartE2EDuration="2.009762246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:10:57.007865633 +0000 UTC m=+1331.139992878" watchObservedRunningTime="2026-09-10 00:10:57.009762246 +0000 UTC m=+1331.141889473"
Sep 10 00:10:57.203526 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:57.203493    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 10 00:10:57.203692 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:57.203543    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 10 00:10:57.309606 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:57.309576    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:57.311329 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:57.311304    2560 patch_prober.go:28] interesting pod/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 00:10:57.311458 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:57.311353    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 00:10:58.204141 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:58.204102    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 10 00:10:58.204539 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:58.204162    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 10 00:10:58.314416 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:58.314378    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:58.869642 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:58.869538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:58.968373 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:58.968325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:10:59.001177 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:59.001151    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:59.002050 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:59.002026    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:10:59.203285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:59.203198    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 10 00:10:59.203285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:10:59.203257    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 10 00:11:00.003768 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:00.003684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:00.067439 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:00.067401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:00.166306 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:00.166270    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:00.203112 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:00.203076    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 10 00:11:00.203261 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:00.203132    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 10 00:11:00.572541 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:00.572499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:00.629769 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:00.629730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:01.206899 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:01.206868    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:11:01.207358 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:01.207160    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:11:01.207919 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:01.207900    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:11:01.996055 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:01.996024    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:11:07.347508 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:07.347468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:09.198052 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:09.197966    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:11:13.837582 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:13.837532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:16.715875 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:16.715840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:17.021587 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.021496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:17.282182 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.282086    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"]
Sep 10 00:11:17.286212 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.286191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.289089 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.289068    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-b1baac-openshift-default-dockercfg-t6h48\""
Sep 10 00:11:17.299795 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.299282    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"]
Sep 10 00:11:17.314085 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.314059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:17.407586 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.407538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-token\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.407772 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.407616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-certs\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.407772 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.407715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-envoy\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.407772 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.407740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-data\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.407967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.407771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4c2w\" (UniqueName: \"kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-kube-api-access-f4c2w\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.407967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.407826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-socket\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.407967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.407866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-credential-socket\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.407967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.407919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istiod-ca-cert\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.408184 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.407968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-podinfo\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.509311 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-socket\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.509500 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509339    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-credential-socket\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.509500 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istiod-ca-cert\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.509500 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-podinfo\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.509695 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-token\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.509695 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-certs\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.509864 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-socket\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.509864 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-envoy\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.509864 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-data\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.509864 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4c2w\" (UniqueName: \"kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-kube-api-access-f4c2w\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.510087 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.509927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-credential-socket\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.510565 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.510513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-data\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.510696 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.510563    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istiod-ca-cert\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.510696 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.510628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-certs\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.512636 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.512612    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-podinfo\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.513161 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.513138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-envoy\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.517413 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.517380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-token\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.518149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.518127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4c2w\" (UniqueName: \"kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-kube-api-access-f4c2w\") pod \"e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") " pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.600829 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.600792    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:17.720429 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.720369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:17.902764 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.902674    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"]
Sep 10 00:11:17.906105 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:11:17.906067    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38df01a5_b33b_4fdc_b80c_b724b25ba18b.slice/crio-f624a388893e6477c92e0349d97a260fc4b7f038c6e051910c5478ca6f6dd3d4 WatchSource:0}: Error finding container f624a388893e6477c92e0349d97a260fc4b7f038c6e051910c5478ca6f6dd3d4: Status 404 returned error can't find the container with id f624a388893e6477c92e0349d97a260fc4b7f038c6e051910c5478ca6f6dd3d4
Sep 10 00:11:17.909296 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.909255    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:17.909385 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.909353    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:17.909431 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:17.909393    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:18.125818 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:18.125776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" event={"ID":"38df01a5-b33b-4fdc-b80c-b724b25ba18b","Type":"ContainerStarted","Data":"ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2"}
Sep 10 00:11:18.126046 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:18.125845    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" event={"ID":"38df01a5-b33b-4fdc-b80c-b724b25ba18b","Type":"ContainerStarted","Data":"f624a388893e6477c92e0349d97a260fc4b7f038c6e051910c5478ca6f6dd3d4"}
Sep 10 00:11:18.148644 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:18.147255    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" podStartSLOduration=1.147232914 podStartE2EDuration="1.147232914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:11:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:11:18.143482995 +0000 UTC m=+1352.275610232" watchObservedRunningTime="2026-09-10 00:11:18.147232914 +0000 UTC m=+1352.279360143"
Sep 10 00:11:18.601734 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:18.601692    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:18.603181 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:18.603147    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 00:11:18.603316 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:18.603251    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 00:11:19.605813 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:19.605781    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:20.021171 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:20.021068    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:20.123549 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:20.123515    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:20.140349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:20.140323    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:20.141378 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:20.141359    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:20.927735 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:20.927706    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 00:11:20.928090 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:20.927760    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 00:11:21.136435 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.136352    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"]
Sep 10 00:11:21.140328 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.140297    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.142779 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.142757    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-b1baac-serving-cert\""
Sep 10 00:11:21.151818 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.151792    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"]
Sep 10 00:11:21.155460 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.155435    2560 generic.go:356] "Generic (PLEG): container finished" podID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerID="7c24d1118ebcae1a347cfda5f34ae7fabe9bc3834cc1a874486b5ac3993d737e" exitCode=0
Sep 10 00:11:21.155621 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.155601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" event={"ID":"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba","Type":"ContainerDied","Data":"7c24d1118ebcae1a347cfda5f34ae7fabe9bc3834cc1a874486b5ac3993d737e"}
Sep 10 00:11:21.156360 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.156330    2560 scope.go:117] "RemoveContainer" containerID="7c24d1118ebcae1a347cfda5f34ae7fabe9bc3834cc1a874486b5ac3993d737e"
Sep 10 00:11:21.157871 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.157743    2560 generic.go:356] "Generic (PLEG): container finished" podID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerID="7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb" exitCode=0
Sep 10 00:11:21.158175 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.158148    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" event={"ID":"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6","Type":"ContainerDied","Data":"7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb"}
Sep 10 00:11:21.158620 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.158598    2560 scope.go:117] "RemoveContainer" containerID="7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb"
Sep 10 00:11:21.159882 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.159849    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:21.160010 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.159979    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:21.160067 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.160027    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:21.160115 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.160051    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:21.160160 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.160133    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:21.160244 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.160217    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:21.168352 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.168325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:21.240623 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.240595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:21.256096 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.255779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c522l\" (UniqueName: \"kubernetes.io/projected/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-kube-api-access-c522l\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.256096 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.255997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.256558 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.256497    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.257132 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.256802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.343050 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.342966    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:21.359082 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.357653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.359082 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.357712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.359082 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.357833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.359082 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.357920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c522l\" (UniqueName: \"kubernetes.io/projected/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-kube-api-access-c522l\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.359976 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.359745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.362897 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.362851    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.365333 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.363608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.372064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.372014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c522l\" (UniqueName: \"kubernetes.io/projected/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-kube-api-access-c522l\") pod \"maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.459288 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.459202    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:21.749163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.749129    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"]
Sep 10 00:11:21.750022 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:11:21.749993    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cfe1cc_61aa_4b16_9f35_2c288e866ec6.slice/crio-fbfa2db9144df1e94bb8bc6102f92f1ec1b38ec531a783e49109813256209c13 WatchSource:0}: Error finding container fbfa2db9144df1e94bb8bc6102f92f1ec1b38ec531a783e49109813256209c13: Status 404 returned error can't find the container with id fbfa2db9144df1e94bb8bc6102f92f1ec1b38ec531a783e49109813256209c13
Sep 10 00:11:21.751983 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.751952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:21.935671 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:21.935640    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:22.203590 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.203545    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" event={"ID":"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6","Type":"ContainerStarted","Data":"8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173"}
Sep 10 00:11:22.209620 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.209535    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" event={"ID":"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba","Type":"ContainerStarted","Data":"0ee748173eae98aa137f351291464c7dd705e5199b3102b17f0fdfa869d1796e"}
Sep 10 00:11:22.211218 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.211194    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4" event={"ID":"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6","Type":"ContainerStarted","Data":"fbfa2db9144df1e94bb8bc6102f92f1ec1b38ec531a783e49109813256209c13"}
Sep 10 00:11:22.233490 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.233456    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:22.309964 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.309911    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:11:22.310172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.310060    2560 patch_prober.go:28] interesting pod/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 00:11:22.310172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.310107    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 00:11:22.600199 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.599754    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:11:22.600199 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.599868    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 00:11:22.600199 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.599910    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 00:11:22.936086 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:22.935843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:23.219662 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:23.219499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4" event={"ID":"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6","Type":"ContainerStarted","Data":"7e910e1a734f694ba5859c83e4cfd4897d5c2cfaa96a16d8a225276399432016"}
Sep 10 00:11:23.219835 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:23.219809    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:23.236581 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:23.236540    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4" podStartSLOduration=1.766237896 podStartE2EDuration="2.236526093s" totalImagesPullingTime="470.288197ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:11:23.234791727 +0000 UTC m=+1357.366918956" watchObservedRunningTime="2026-09-10 00:11:23.236526093 +0000 UTC m=+1357.368653321"
Sep 10 00:11:23.309507 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:23.309468    2560 patch_prober.go:28] interesting pod/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 00:11:23.309684 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:23.309528    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 00:11:23.599581 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:23.599542    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 00:11:23.599772 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:23.599623    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 00:11:23.642190 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:23.642160    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:23.803684 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:23.803642    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:24.309408 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:24.309363    2560 patch_prober.go:28] interesting pod/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 00:11:24.309813 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:24.309430    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 00:11:24.599191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:24.599093    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 00:11:24.599191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:24.599157    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 00:11:25.309892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:25.309858    2560 patch_prober.go:28] interesting pod/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 00:11:25.310293 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:25.309914    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 00:11:25.599727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:25.599640    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 00:11:25.599977 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:25.599925    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 00:11:25.787157 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:25.787116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:25.843160 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:25.843125    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:26.309863 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:26.309824    2560 patch_prober.go:28] interesting pod/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 00:11:26.310060 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:26.309877    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 00:11:26.599408 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:26.599309    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 00:11:26.599408 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:26.599378    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 00:11:27.309610 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:27.309561    2560 patch_prober.go:28] interesting pod/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 00:11:27.309798 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:27.309631    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 00:11:27.632069 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:27.631974    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:11:27.632715 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:27.632655    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:11:27.633652 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:27.633627    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:11:28.313358 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:28.313325    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:11:28.313625 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:28.313606    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:11:28.314169 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:28.314154    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:11:29.230903 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:29.230873    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:11:42.254885 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:42.254777    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:42.335161 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:42.335125    2560 generic.go:356] "Generic (PLEG): container finished" podID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerID="ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2" exitCode=0
Sep 10 00:11:42.340138 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:42.340103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" event={"ID":"38df01a5-b33b-4fdc-b80c-b724b25ba18b","Type":"ContainerDied","Data":"ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2"}
Sep 10 00:11:42.340481 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:42.340463    2560 scope.go:117] "RemoveContainer" containerID="ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2"
Sep 10 00:11:42.341672 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:42.341646    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:42.341738 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:42.341714    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:42.341776 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:42.341746    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:11:43.343138 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:43.343102    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" event={"ID":"38df01a5-b33b-4fdc-b80c-b724b25ba18b","Type":"ContainerStarted","Data":"dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa"}
Sep 10 00:11:43.601044 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:43.600925    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:43.601194 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:43.601167    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 00:11:43.601238 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:43.601212    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 00:11:44.601331 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:44.601293    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 00:11:44.601745 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:44.601363    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 00:11:44.971024 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:44.970919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:45.601524 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:45.601486    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 00:11:45.601957 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:45.601539    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 00:11:46.136823 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:46.136786    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:46.444514 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:46.444419    2560 scope.go:117] "RemoveContainer" containerID="062a590d32084ff3bed01f2f71dfeb38f948e8240b1e953452a9192b16a3df41"
Sep 10 00:11:46.601893 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:46.601854    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 00:11:46.602303 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:46.601924    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 00:11:47.601366 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:47.601330    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 00:11:47.601543 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:47.601386    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 00:11:48.605979 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:48.605922    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:48.606346 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:48.606230    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:48.606832 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:48.606814    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:11:53.561125 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:53.561092    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:11:54.698943 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:54.698905    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:11:58.691598 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:11:58.691562    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:12:10.844076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:12:10.844036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:12:18.704739 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:12:18.704703    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:12:22.159562 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:12:22.159521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:12:30.960603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:12:30.960567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:12:46.495984 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:12:46.495881    2560 scope.go:117] "RemoveContainer" containerID="6855305f3d40b8b476decb31e9fe35e3e65a42bc34782d9cdf9b29f42ae86a21"
Sep 10 00:13:03.598146 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:03.598095    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:13:28.167494 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:28.167453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:13:29.510130 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:29.510092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:13:36.000404 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:36.000366    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:13:36.075516 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:36.075476    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:13:46.402658 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:46.402625    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:13:46.403489 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:46.403474    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:13:46.518800 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:46.518761    2560 scope.go:117] "RemoveContainer" containerID="04da50ff3bab36638f18e1e613cf9e8336054c135dd200bf970bebd962fb9f4c"
Sep 10 00:13:48.078668 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:48.078628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:13:51.511671 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:51.511625    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:13:51.613274 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:51.613239    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:13:51.713984 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:51.713949    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:13:51.821038 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:51.820964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:13:54.852066 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:54.852031    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:13:59.925275 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:13:59.925240    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:14:00.748479 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:00.748448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:14:11.433095 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:11.433003    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:14:16.967541 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:16.967496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:14:29.458533 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:29.458500    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:14:30.169636 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:30.169594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:14:32.365798 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:32.365764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:14:36.118514 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:36.118477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:14:37.021583 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:37.021550    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:14:37.390174 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:37.390143    2560 generic.go:356] "Generic (PLEG): container finished" podID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerID="4a557def4a2ab71cdd888fc696420b2feaa9a8a062f4c8f5ee1bb83209ea5eb7" exitCode=137
Sep 10 00:14:37.390491 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:37.390220    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" event={"ID":"054a0ee3-3117-4578-b0e4-eb41fdcc14e6","Type":"ContainerDied","Data":"4a557def4a2ab71cdd888fc696420b2feaa9a8a062f4c8f5ee1bb83209ea5eb7"}
Sep 10 00:14:37.390559 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:37.390545    2560 scope.go:117] "RemoveContainer" containerID="4a557def4a2ab71cdd888fc696420b2feaa9a8a062f4c8f5ee1bb83209ea5eb7"
Sep 10 00:14:38.397744 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:38.397712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" event={"ID":"054a0ee3-3117-4578-b0e4-eb41fdcc14e6","Type":"ContainerStarted","Data":"68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d"}
Sep 10 00:14:38.398214 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:38.398095    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 10 00:14:42.552371 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:42.552333    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:14:46.542240 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:46.542212    2560 scope.go:117] "RemoveContainer" containerID="40178fc5bc53175bfabe1a10d2158d70ba1e7e538dba9af570382db4e64d725b"
Sep 10 00:14:49.406042 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:14:49.406011    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 10 00:15:00.168948 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:00.168893    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816655-jgxr2"]
Sep 10 00:15:00.171731 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:00.171709    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-jgxr2"
Sep 10 00:15:00.174234 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:00.174213    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxc4l\""
Sep 10 00:15:00.181317 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:00.181291    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816655-jgxr2"]
Sep 10 00:15:00.184223 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:00.184204    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-jgxr2"
Sep 10 00:15:00.458651 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:00.458620    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816655-jgxr2"]
Sep 10 00:15:00.459964 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:15:00.459920    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7b8b1a_f722_44c4_8813_468017d497ce.slice/crio-e09d03cc9630525e8a6b982e4bd939c8dcdec5261d0107f2307e80f28595b393 WatchSource:0}: Error finding container e09d03cc9630525e8a6b982e4bd939c8dcdec5261d0107f2307e80f28595b393: Status 404 returned error can't find the container with id e09d03cc9630525e8a6b982e4bd939c8dcdec5261d0107f2307e80f28595b393
Sep 10 00:15:00.530803 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:00.530772    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-jgxr2" event={"ID":"3b7b8b1a-f722-44c4-8813-468017d497ce","Type":"ContainerStarted","Data":"e09d03cc9630525e8a6b982e4bd939c8dcdec5261d0107f2307e80f28595b393"}
Sep 10 00:15:01.537988 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:01.537955    2560 generic.go:356] "Generic (PLEG): container finished" podID="3b7b8b1a-f722-44c4-8813-468017d497ce" containerID="932d2524930712a912730d141487d17e8fd113f0f71c917cfffd2c9a97c0daa1" exitCode=0
Sep 10 00:15:01.538354 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:01.538047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-jgxr2" event={"ID":"3b7b8b1a-f722-44c4-8813-468017d497ce","Type":"ContainerDied","Data":"932d2524930712a912730d141487d17e8fd113f0f71c917cfffd2c9a97c0daa1"}
Sep 10 00:15:02.686531 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:02.686503    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-jgxr2"
Sep 10 00:15:03.550616 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:03.550584    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-jgxr2"
Sep 10 00:15:03.550784 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:03.550618    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816655-jgxr2" event={"ID":"3b7b8b1a-f722-44c4-8813-468017d497ce","Type":"ContainerDied","Data":"e09d03cc9630525e8a6b982e4bd939c8dcdec5261d0107f2307e80f28595b393"}
Sep 10 00:15:03.550784 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:03.550663    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e09d03cc9630525e8a6b982e4bd939c8dcdec5261d0107f2307e80f28595b393"
Sep 10 00:15:07.202197 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:07.202163    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:15:14.201699 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:14.201660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:14.270032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:14.269974    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:14.458409 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:14.458328    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"]
Sep 10 00:15:14.458660 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:14.458625    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy" containerID="cri-o://0ee748173eae98aa137f351291464c7dd705e5199b3102b17f0fdfa869d1796e" gracePeriod=30
Sep 10 00:15:14.529700 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:14.529667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:15.760966 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:15.760919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:15.863514 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:15.863477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:16.033632 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:16.033548    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:16.578267 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:16.578236    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:16.662894 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:16.662852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:16.763360 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:16.763330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:17.512167 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:17.512121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:18.010000 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:18.009951    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:19.656860 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.656829    2560 generic.go:356] "Generic (PLEG): container finished" podID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerID="0ee748173eae98aa137f351291464c7dd705e5199b3102b17f0fdfa869d1796e" exitCode=0
Sep 10 00:15:19.657312 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.656910    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" event={"ID":"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba","Type":"ContainerDied","Data":"0ee748173eae98aa137f351291464c7dd705e5199b3102b17f0fdfa869d1796e"}
Sep 10 00:15:19.657312 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.657006    2560 scope.go:117] "RemoveContainer" containerID="7c24d1118ebcae1a347cfda5f34ae7fabe9bc3834cc1a874486b5ac3993d737e"
Sep 10 00:15:19.710364 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.710340    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:15:19.828432 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828396    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tccpz\" (UniqueName: \"kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-kube-api-access-tccpz\") pod \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") "
Sep 10 00:15:19.828593 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828472    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-data\") pod \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") "
Sep 10 00:15:19.828593 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828562    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-token\") pod \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") "
Sep 10 00:15:19.828668 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828617    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-socket\") pod \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") "
Sep 10 00:15:19.828668 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828654    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-podinfo\") pod \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") "
Sep 10 00:15:19.828757 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828721    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istiod-ca-cert\") pod \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") "
Sep 10 00:15:19.828808 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828755    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" (UID: "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:15:19.828808 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828773    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-envoy\") pod \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") "
Sep 10 00:15:19.828808 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828803    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-certs\") pod \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") "
Sep 10 00:15:19.829001 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-credential-socket\") pod \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\" (UID: \"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba\") "
Sep 10 00:15:19.829001 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.828915    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" (UID: "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:15:19.829143 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.829111    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" (UID: "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:15:19.829255 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.829230    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" (UID: "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:15:19.829335 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.829242    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" (UID: "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:15:19.829452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.829418    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:15:19.829452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.829445    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:15:19.829553 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.829461    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:15:19.829553 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.829474    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:15:19.829553 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.829487    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:15:19.830896 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.830875    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" (UID: "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:15:19.831015 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.830956    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" (UID: "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:15:19.831170 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.831152    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-kube-api-access-tccpz" (OuterVolumeSpecName: "kube-api-access-tccpz") pod "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" (UID: "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba"). InnerVolumeSpecName "kube-api-access-tccpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:15:19.831170 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.831166    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" (UID: "d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:15:19.930507 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.930478    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tccpz\" (UniqueName: \"kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-kube-api-access-tccpz\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:15:19.930507 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.930503    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:15:19.930507 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.930512    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:15:19.930723 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:19.930521    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:15:20.664676 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:20.664596    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"
Sep 10 00:15:20.664676 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:20.664607    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8" event={"ID":"d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba","Type":"ContainerDied","Data":"99672e741a2a1ce106ae4d9c30e6a371c3eae36c33ce1bcaa8257d31ec403106"}
Sep 10 00:15:20.664676 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:20.664663    2560 scope.go:117] "RemoveContainer" containerID="0ee748173eae98aa137f351291464c7dd705e5199b3102b17f0fdfa869d1796e"
Sep 10 00:15:20.684505 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:20.684476    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"]
Sep 10 00:15:20.688395 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:20.688374    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8"]
Sep 10 00:15:22.340237 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:22.340205    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" path="/var/lib/kubelet/pods/d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba/volumes"
Sep 10 00:15:23.910167 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:23.910136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:23.979946 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:23.979905    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:24.566120 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:24.566086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:30.514634 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:30.514602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:30.617560 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:30.617508    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:30.715142 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:30.715105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:34.708442 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:34.708400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:41.204976 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.204852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:41.433824 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.433762    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:41.857405 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.857372    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"]
Sep 10 00:15:41.857898 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.857878    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7b8b1a-f722-44c4-8813-468017d497ce" containerName="cleanup"
Sep 10 00:15:41.858032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.857901    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7b8b1a-f722-44c4-8813-468017d497ce" containerName="cleanup"
Sep 10 00:15:41.858032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.857956    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy"
Sep 10 00:15:41.858032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.857968    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy"
Sep 10 00:15:41.858193 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.858090    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy"
Sep 10 00:15:41.858193 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.858102    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b7b8b1a-f722-44c4-8813-468017d497ce" containerName="cleanup"
Sep 10 00:15:41.858193 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.858112    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy"
Sep 10 00:15:41.861602 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.861516    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:41.867790 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.867765    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-cc0040\"/\"e2e-conflict-a-9fc73175-kserve-self-signed-certs\""
Sep 10 00:15:41.879437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.879411    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"]
Sep 10 00:15:41.906529 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.906500    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:41.953469 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.953442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee41fbff-ad54-43d0-b8a6-64d15c596017-tls-certs\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:41.953569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.953485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-home\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:41.953569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.953509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bwp2\" (UniqueName: \"kubernetes.io/projected/ee41fbff-ad54-43d0-b8a6-64d15c596017-kube-api-access-9bwp2\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:41.953669 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.953645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-model-cache\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:41.953707 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.953689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-dshm\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:41.953753 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:41.953740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-tmp-dir\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.054649 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.054615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-tmp-dir\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.054833 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.054691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee41fbff-ad54-43d0-b8a6-64d15c596017-tls-certs\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.054833 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.054736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-home\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.054833 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.054760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bwp2\" (UniqueName: \"kubernetes.io/projected/ee41fbff-ad54-43d0-b8a6-64d15c596017-kube-api-access-9bwp2\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.055043 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.054864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-model-cache\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.055043 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.054895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-dshm\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.055163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.055082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-tmp-dir\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.055163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.055145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-home\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.055327 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.055298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-model-cache\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.057177 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.057147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-dshm\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.057396 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.057374    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee41fbff-ad54-43d0-b8a6-64d15c596017-tls-certs\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.066624 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.066604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bwp2\" (UniqueName: \"kubernetes.io/projected/ee41fbff-ad54-43d0-b8a6-64d15c596017-kube-api-access-9bwp2\") pod \"e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.171517 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.171433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:42.445439 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.445417    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"]
Sep 10 00:15:42.446883 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:15:42.446847    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee41fbff_ad54_43d0_b8a6_64d15c596017.slice/crio-6d6962b16c2b05e4b04fb8ba206217da2a75d5a0a75f9205a16386a2e10a2ac7 WatchSource:0}: Error finding container 6d6962b16c2b05e4b04fb8ba206217da2a75d5a0a75f9205a16386a2e10a2ac7: Status 404 returned error can't find the container with id 6d6962b16c2b05e4b04fb8ba206217da2a75d5a0a75f9205a16386a2e10a2ac7
Sep 10 00:15:42.795890 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.795806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk" event={"ID":"ee41fbff-ad54-43d0-b8a6-64d15c596017","Type":"ContainerStarted","Data":"6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc"}
Sep 10 00:15:42.795890 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.795847    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk" event={"ID":"ee41fbff-ad54-43d0-b8a6-64d15c596017","Type":"ContainerStarted","Data":"6d6962b16c2b05e4b04fb8ba206217da2a75d5a0a75f9205a16386a2e10a2ac7"}
Sep 10 00:15:42.819507 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:42.819441    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk" podStartSLOduration=1.819420305 podStartE2EDuration="1.819420305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:15:42.819017279 +0000 UTC m=+1616.951144508" watchObservedRunningTime="2026-09-10 00:15:42.819420305 +0000 UTC m=+1616.951547535"
Sep 10 00:15:44.424707 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:44.424675    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:15:46.564878 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:46.564839    2560 scope.go:117] "RemoveContainer" containerID="32f92092e971fb4789a2d40b1965e9f30b1508abfbfcef3c158e6a615fc4e182"
Sep 10 00:15:51.804411 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:51.804378    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:15:52.172300 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:52.172203    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:52.172300 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:52.172256    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:52.184886 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:52.184861    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:15:52.868732 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:15:52.868701    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:16:02.321683 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:02.321647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:07.972409 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:07.972374    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:08.073220 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.073191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:08.254569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.254484    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"]
Sep 10 00:16:08.255478 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.255449    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy"
Sep 10 00:16:08.255695 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.255674    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b11bc3-b8ae-4b8e-bfbf-ceeead3448ba" containerName="istio-proxy"
Sep 10 00:16:08.259099 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.259076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.261611 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.261585    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-cc0040\"/\"e2e-conflict-b-9fc73175-kserve-self-signed-certs\""
Sep 10 00:16:08.273318 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.268221    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"]
Sep 10 00:16:08.286906 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.286880    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:08.323271 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.323243    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-home\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.323386 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.323330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-model-cache\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.323386 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.323363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-tmp-dir\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.323465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.323383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a7412c-a6a2-4594-a68b-077b70b62b66-tls-certs\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.323465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.323448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x5j7\" (UniqueName: \"kubernetes.io/projected/26a7412c-a6a2-4594-a68b-077b70b62b66-kube-api-access-2x5j7\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.323532 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.323513    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-dshm\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.387417 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.387391    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:08.433956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.424614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-tmp-dir\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.433956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.424671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a7412c-a6a2-4594-a68b-077b70b62b66-tls-certs\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.433956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.424719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x5j7\" (UniqueName: \"kubernetes.io/projected/26a7412c-a6a2-4594-a68b-077b70b62b66-kube-api-access-2x5j7\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.433956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.424768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-dshm\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.433956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.424841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-home\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.433956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.424977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-model-cache\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.433956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.425418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-model-cache\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.433956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.425689    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-tmp-dir\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.433956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.426768    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-home\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.440559 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.440529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-dshm\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.448479 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.447627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a7412c-a6a2-4594-a68b-077b70b62b66-tls-certs\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.450651 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.450609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x5j7\" (UniqueName: \"kubernetes.io/projected/26a7412c-a6a2-4594-a68b-077b70b62b66-kube-api-access-2x5j7\") pod \"e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") " pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.578561 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.578528    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"]
Sep 10 00:16:08.582466 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.582442    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.582852 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.582827    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:08.585052 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.585031    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-beac5e-openshift-default-dockercfg-8jh4t\""
Sep 10 00:16:08.595840 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.595818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"]
Sep 10 00:16:08.601680 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.601653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:08.628427 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.628399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-data\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.628597 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.628466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-socket\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.628597 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.628506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/365e1102-10c5-403a-930a-649fb5bf24db-istiod-ca-cert\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.628597 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.628550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbg5g\" (UniqueName: \"kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-kube-api-access-pbg5g\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.628766 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.628597    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-certs\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.628766 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.628673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/365e1102-10c5-403a-930a-649fb5bf24db-istio-podinfo\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.628766 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.628752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-envoy\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.628971 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.628780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-credential-socket\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.628971 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.628818    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-istio-token\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.729733 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.729683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-data\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.729898 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.729757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-socket\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.729898 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.729791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/365e1102-10c5-403a-930a-649fb5bf24db-istiod-ca-cert\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.729898 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.729829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbg5g\" (UniqueName: \"kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-kube-api-access-pbg5g\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.730052 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.729889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-certs\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.730052 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.730000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/365e1102-10c5-403a-930a-649fb5bf24db-istio-podinfo\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.730124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.730088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-envoy\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.730124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.730115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-credential-socket\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.730189 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.730156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-istio-token\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.730975 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.730898    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-data\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.731238 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.731204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-socket\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.732337 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.731825    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/365e1102-10c5-403a-930a-649fb5bf24db-istiod-ca-cert\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.732337 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.731864    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-certs\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.732713 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.732691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-credential-socket\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.735681 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.735655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-envoy\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.736100 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.736072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/365e1102-10c5-403a-930a-649fb5bf24db-istio-podinfo\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.738597 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.738571    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-istio-token\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.743926 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.743905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbg5g\" (UniqueName: \"kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-kube-api-access-pbg5g\") pod \"e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") " pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.770586 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.770548    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:08.866860 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.866832    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"]
Sep 10 00:16:08.868078 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:16:08.868055    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26a7412c_a6a2_4594_a68b_077b70b62b66.slice/crio-3f4340ad1c2ce241664a1eec8562b71cb4f3c4d187d9aa42a88bf6d16a04c425 WatchSource:0}: Error finding container 3f4340ad1c2ce241664a1eec8562b71cb4f3c4d187d9aa42a88bf6d16a04c425: Status 404 returned error can't find the container with id 3f4340ad1c2ce241664a1eec8562b71cb4f3c4d187d9aa42a88bf6d16a04c425
Sep 10 00:16:08.895526 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.895504    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:08.960349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.959368    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs" event={"ID":"26a7412c-a6a2-4594-a68b-077b70b62b66","Type":"ContainerStarted","Data":"507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0"}
Sep 10 00:16:08.960349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.959421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs" event={"ID":"26a7412c-a6a2-4594-a68b-077b70b62b66","Type":"ContainerStarted","Data":"3f4340ad1c2ce241664a1eec8562b71cb4f3c4d187d9aa42a88bf6d16a04c425"}
Sep 10 00:16:08.976910 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:08.976862    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs" podStartSLOduration=0.976845724 podStartE2EDuration="976.845724ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:16:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:16:08.976354416 +0000 UTC m=+1643.108481648" watchObservedRunningTime="2026-09-10 00:16:08.976845724 +0000 UTC m=+1643.108972951"
Sep 10 00:16:09.170087 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:09.170048    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"]
Sep 10 00:16:09.171248 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:16:09.171225    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365e1102_10c5_403a_930a_649fb5bf24db.slice/crio-98a7fd8d02440f06fa72bf4bea0060c714500e4c498f877bffa77103a0f99732 WatchSource:0}: Error finding container 98a7fd8d02440f06fa72bf4bea0060c714500e4c498f877bffa77103a0f99732: Status 404 returned error can't find the container with id 98a7fd8d02440f06fa72bf4bea0060c714500e4c498f877bffa77103a0f99732
Sep 10 00:16:09.173618 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:09.173588    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:16:09.173667 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:09.173653    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:16:09.173703 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:09.173680    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:16:09.966351 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:09.966319    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" event={"ID":"365e1102-10c5-403a-930a-649fb5bf24db","Type":"ContainerStarted","Data":"7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8"}
Sep 10 00:16:09.966534 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:09.966372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" event={"ID":"365e1102-10c5-403a-930a-649fb5bf24db","Type":"ContainerStarted","Data":"98a7fd8d02440f06fa72bf4bea0060c714500e4c498f877bffa77103a0f99732"}
Sep 10 00:16:09.990876 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:09.990829    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" podStartSLOduration=1.990814552 podStartE2EDuration="1.990814552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:16:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:16:09.987594698 +0000 UTC m=+1644.119721926" watchObservedRunningTime="2026-09-10 00:16:09.990814552 +0000 UTC m=+1644.122941779"
Sep 10 00:16:10.896193 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:10.896151    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:10.901609 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:10.901582    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:10.971887 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:10.971856    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:10.972834 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:10.972813    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:16:11.896774 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:11.896744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:12.055106 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:12.055078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:13.144889 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:13.144852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:13.245145 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:13.245112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:13.368725 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:13.368695    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:13.698478 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:13.698445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:13.816709 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:13.816677    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:13.961504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:13.961414    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:14.060745 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:14.060714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:14.492640 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:14.492606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:15.333352 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:15.333310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:18.583434 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:18.583397    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:18.583850 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:18.583445    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:18.595891 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:18.595867    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:19.023277 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:19.023174    2560 generic.go:356] "Generic (PLEG): container finished" podID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerID="68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d" exitCode=137
Sep 10 00:16:19.023277 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:19.023242    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" event={"ID":"054a0ee3-3117-4578-b0e4-eb41fdcc14e6","Type":"ContainerDied","Data":"68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d"}
Sep 10 00:16:19.023525 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:19.023323    2560 scope.go:117] "RemoveContainer" containerID="4a557def4a2ab71cdd888fc696420b2feaa9a8a062f4c8f5ee1bb83209ea5eb7"
Sep 10 00:16:19.023794 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:19.023769    2560 scope.go:117] "RemoveContainer" containerID="68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d"
Sep 10 00:16:19.024118 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:16:19.024059    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kuadrant-operator-controller-manager-5769f99d9f-2c72d_kuadrant-system(054a0ee3-3117-4578-b0e4-eb41fdcc14e6)\"" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6"
Sep 10 00:16:19.035499 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:19.035478    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:19.405041 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:19.404995    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 10 00:16:20.031343 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:20.031312    2560 scope.go:117] "RemoveContainer" containerID="68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d"
Sep 10 00:16:20.031778 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:16:20.031565    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kuadrant-operator-controller-manager-5769f99d9f-2c72d_kuadrant-system(054a0ee3-3117-4578-b0e4-eb41fdcc14e6)\"" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6"
Sep 10 00:16:32.578533 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:32.578496    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"]
Sep 10 00:16:32.595948 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:32.595905    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:34.334267 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:34.334236    2560 scope.go:117] "RemoveContainer" containerID="68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d"
Sep 10 00:16:34.609422 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:34.609338    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"]
Sep 10 00:16:34.634245 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:34.634212    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:35.119176 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:35.119139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" event={"ID":"054a0ee3-3117-4578-b0e4-eb41fdcc14e6","Type":"ContainerStarted","Data":"828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a"}
Sep 10 00:16:35.119370 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:35.119352    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 10 00:16:36.856495 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:36.856461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:37.300686 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.300657    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:37.560864 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.560772    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"]
Sep 10 00:16:37.565535 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.565514    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.568133 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.568113    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b9483e-openshift-default-dockercfg-2bsdq\""
Sep 10 00:16:37.576649 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.576621    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"]
Sep 10 00:16:37.589296 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.589266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:37.642728 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.642706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-istio-token\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.642857 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.642734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7xfw\" (UniqueName: \"kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-kube-api-access-z7xfw\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.642857 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.642765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-envoy\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.643005 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.642867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/753dc45a-aac1-4982-9050-2c245bf9d362-istio-podinfo\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.643005 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.642904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-certs\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.643115 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.642993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-credential-socket\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.643115 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.643033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-data\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.643115 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.643083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-socket\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.643212 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.643123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/753dc45a-aac1-4982-9050-2c245bf9d362-istiod-ca-cert\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.744557 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.744519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/753dc45a-aac1-4982-9050-2c245bf9d362-istiod-ca-cert\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.744720 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.744598    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-istio-token\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.744720 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.744617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7xfw\" (UniqueName: \"kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-kube-api-access-z7xfw\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.744720 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.744662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-envoy\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.744827 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.744751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/753dc45a-aac1-4982-9050-2c245bf9d362-istio-podinfo\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.744866 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.744826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-certs\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.744904 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.744870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-credential-socket\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.744904 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.744895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-data\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.745090 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.745045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-socket\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.745339 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.745310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-certs\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.745441 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.745346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/753dc45a-aac1-4982-9050-2c245bf9d362-istiod-ca-cert\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.745441 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.745386    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-credential-socket\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.745555 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.745471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-socket\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.745555 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.745496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-data\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.747105 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.747080    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-envoy\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.747379 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.747361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/753dc45a-aac1-4982-9050-2c245bf9d362-istio-podinfo\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.752574 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.752553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-istio-token\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.752943 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.752909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7xfw\" (UniqueName: \"kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-kube-api-access-z7xfw\") pod \"e2e-api-b-b9483e-openshift-default-57866d8676-pngwh\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") " pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:37.837331 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.837245    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:37.877134 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:37.877108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:38.162558 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:38.162527    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"]
Sep 10 00:16:38.163600 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:16:38.163569    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753dc45a_aac1_4982_9050_2c245bf9d362.slice/crio-82e850cba48ffb9e4b620e5d0074d5cb685d95b2a64b496c11c293a78bfa25cd WatchSource:0}: Error finding container 82e850cba48ffb9e4b620e5d0074d5cb685d95b2a64b496c11c293a78bfa25cd: Status 404 returned error can't find the container with id 82e850cba48ffb9e4b620e5d0074d5cb685d95b2a64b496c11c293a78bfa25cd
Sep 10 00:16:38.166016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:38.165985    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:16:38.166110 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:38.166050    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:16:38.166110 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:38.166101    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:16:39.147450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:39.147413    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" event={"ID":"753dc45a-aac1-4982-9050-2c245bf9d362","Type":"ContainerStarted","Data":"8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099"}
Sep 10 00:16:39.147904 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:39.147469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" event={"ID":"753dc45a-aac1-4982-9050-2c245bf9d362","Type":"ContainerStarted","Data":"82e850cba48ffb9e4b620e5d0074d5cb685d95b2a64b496c11c293a78bfa25cd"}
Sep 10 00:16:39.169652 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:39.169601    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" podStartSLOduration=2.169587226 podStartE2EDuration="2.169587226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:16:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:16:39.167004284 +0000 UTC m=+1673.299131512" watchObservedRunningTime="2026-09-10 00:16:39.169587226 +0000 UTC m=+1673.301714454"
Sep 10 00:16:39.877735 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:39.877703    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:39.883069 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:39.883043    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:40.153581 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:40.153495    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:40.154393 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:40.154368    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:16:41.025505 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:41.025461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:41.135481 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:41.135434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:42.187189 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:42.187162    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:42.244028 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:42.244000    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:42.758913 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:42.758880    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:43.051440 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:43.051410    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:43.150596 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:43.150560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:43.251067 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:43.251032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:43.883104 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:43.883070    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:46.127436 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:46.127407    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 10 00:16:46.826991 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:46.826955    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:16:47.599260 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.599220    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs" podUID="26a7412c-a6a2-4594-a68b-077b70b62b66" containerName="main" containerID="cri-o://507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0" gracePeriod=45
Sep 10 00:16:47.853689 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.853618    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:47.953855 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.953822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a7412c-a6a2-4594-a68b-077b70b62b66-tls-certs\") pod \"26a7412c-a6a2-4594-a68b-077b70b62b66\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") "
Sep 10 00:16:47.954052 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.953865    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-dshm\") pod \"26a7412c-a6a2-4594-a68b-077b70b62b66\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") "
Sep 10 00:16:47.954052 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.953915    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-home\") pod \"26a7412c-a6a2-4594-a68b-077b70b62b66\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") "
Sep 10 00:16:47.954052 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.953953    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-tmp-dir\") pod \"26a7412c-a6a2-4594-a68b-077b70b62b66\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") "
Sep 10 00:16:47.954052 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.954036    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x5j7\" (UniqueName: \"kubernetes.io/projected/26a7412c-a6a2-4594-a68b-077b70b62b66-kube-api-access-2x5j7\") pod \"26a7412c-a6a2-4594-a68b-077b70b62b66\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") "
Sep 10 00:16:47.954287 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.954061    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-model-cache\") pod \"26a7412c-a6a2-4594-a68b-077b70b62b66\" (UID: \"26a7412c-a6a2-4594-a68b-077b70b62b66\") "
Sep 10 00:16:47.954287 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.954212    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-home" (OuterVolumeSpecName: "home") pod "26a7412c-a6a2-4594-a68b-077b70b62b66" (UID: "26a7412c-a6a2-4594-a68b-077b70b62b66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:16:47.954287 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.954218    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26a7412c-a6a2-4594-a68b-077b70b62b66" (UID: "26a7412c-a6a2-4594-a68b-077b70b62b66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:16:47.954425 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.954362    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-model-cache" (OuterVolumeSpecName: "model-cache") pod "26a7412c-a6a2-4594-a68b-077b70b62b66" (UID: "26a7412c-a6a2-4594-a68b-077b70b62b66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:16:47.954561 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.954543    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-model-cache\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:47.954598 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.954568    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-home\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:47.954598 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.954582    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-tmp-dir\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:47.956166 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.956137    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-dshm" (OuterVolumeSpecName: "dshm") pod "26a7412c-a6a2-4594-a68b-077b70b62b66" (UID: "26a7412c-a6a2-4594-a68b-077b70b62b66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:16:47.956252 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.956149    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a7412c-a6a2-4594-a68b-077b70b62b66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26a7412c-a6a2-4594-a68b-077b70b62b66" (UID: "26a7412c-a6a2-4594-a68b-077b70b62b66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:16:47.956296 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:47.956255    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26a7412c-a6a2-4594-a68b-077b70b62b66-kube-api-access-2x5j7" (OuterVolumeSpecName: "kube-api-access-2x5j7") pod "26a7412c-a6a2-4594-a68b-077b70b62b66" (UID: "26a7412c-a6a2-4594-a68b-077b70b62b66"). InnerVolumeSpecName "kube-api-access-2x5j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:16:48.055856 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.055817    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x5j7\" (UniqueName: \"kubernetes.io/projected/26a7412c-a6a2-4594-a68b-077b70b62b66-kube-api-access-2x5j7\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:48.055856 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.055849    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a7412c-a6a2-4594-a68b-077b70b62b66-tls-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:48.055856 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.055862    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26a7412c-a6a2-4594-a68b-077b70b62b66-dshm\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:48.202250 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.202165    2560 generic.go:356] "Generic (PLEG): container finished" podID="26a7412c-a6a2-4594-a68b-077b70b62b66" containerID="507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0" exitCode=0
Sep 10 00:16:48.202250 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.202212    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"
Sep 10 00:16:48.202448 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.202246    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs" event={"ID":"26a7412c-a6a2-4594-a68b-077b70b62b66","Type":"ContainerDied","Data":"507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0"}
Sep 10 00:16:48.202448 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.202286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs" event={"ID":"26a7412c-a6a2-4594-a68b-077b70b62b66","Type":"ContainerDied","Data":"3f4340ad1c2ce241664a1eec8562b71cb4f3c4d187d9aa42a88bf6d16a04c425"}
Sep 10 00:16:48.202448 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.202303    2560 scope.go:117] "RemoveContainer" containerID="507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0"
Sep 10 00:16:48.213355 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.213322    2560 scope.go:117] "RemoveContainer" containerID="507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0"
Sep 10 00:16:48.213615 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:16:48.213596    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0\": container with ID starting with 507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0 not found: ID does not exist" containerID="507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0"
Sep 10 00:16:48.213688 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.213620    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0"} err="failed to get container status \"507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0\": rpc error: code = NotFound desc = could not find container \"507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0\": container with ID starting with 507021971d337856c4c7515e2f307c15c36d93ca32333dbfa1a0c122a0910ac0 not found: ID does not exist"
Sep 10 00:16:48.229014 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.228984    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"]
Sep 10 00:16:48.234349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.234322    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-b-9fc73175-kserve-5bfbc799b-l5rvs"]
Sep 10 00:16:48.344034 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:48.344004    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26a7412c-a6a2-4594-a68b-077b70b62b66" path="/var/lib/kubelet/pods/26a7412c-a6a2-4594-a68b-077b70b62b66/volumes"
Sep 10 00:16:49.629893 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.629854    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk" podUID="ee41fbff-ad54-43d0-b8a6-64d15c596017" containerName="main" containerID="cri-o://6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc" gracePeriod=45
Sep 10 00:16:49.908713 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.908682    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:16:49.976701 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.976670    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee41fbff-ad54-43d0-b8a6-64d15c596017-tls-certs\") pod \"ee41fbff-ad54-43d0-b8a6-64d15c596017\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") "
Sep 10 00:16:49.976853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.976719    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-home\") pod \"ee41fbff-ad54-43d0-b8a6-64d15c596017\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") "
Sep 10 00:16:49.976853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.976749    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-dshm\") pod \"ee41fbff-ad54-43d0-b8a6-64d15c596017\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") "
Sep 10 00:16:49.976853 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.976834    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-tmp-dir\") pod \"ee41fbff-ad54-43d0-b8a6-64d15c596017\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") "
Sep 10 00:16:49.977006 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.976918    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bwp2\" (UniqueName: \"kubernetes.io/projected/ee41fbff-ad54-43d0-b8a6-64d15c596017-kube-api-access-9bwp2\") pod \"ee41fbff-ad54-43d0-b8a6-64d15c596017\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") "
Sep 10 00:16:49.977006 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.976957    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-model-cache\") pod \"ee41fbff-ad54-43d0-b8a6-64d15c596017\" (UID: \"ee41fbff-ad54-43d0-b8a6-64d15c596017\") "
Sep 10 00:16:49.977128 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.977050    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-home" (OuterVolumeSpecName: "home") pod "ee41fbff-ad54-43d0-b8a6-64d15c596017" (UID: "ee41fbff-ad54-43d0-b8a6-64d15c596017"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:16:49.977230 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.977200    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee41fbff-ad54-43d0-b8a6-64d15c596017" (UID: "ee41fbff-ad54-43d0-b8a6-64d15c596017"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:16:49.977371 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.977339    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee41fbff-ad54-43d0-b8a6-64d15c596017" (UID: "ee41fbff-ad54-43d0-b8a6-64d15c596017"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:16:49.977489 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.977469    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-tmp-dir\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:49.977543 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.977496    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-model-cache\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:49.977543 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.977510    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-home\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:49.978844 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.978820    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee41fbff-ad54-43d0-b8a6-64d15c596017-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee41fbff-ad54-43d0-b8a6-64d15c596017" (UID: "ee41fbff-ad54-43d0-b8a6-64d15c596017"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:16:49.979325 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.979301    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-dshm" (OuterVolumeSpecName: "dshm") pod "ee41fbff-ad54-43d0-b8a6-64d15c596017" (UID: "ee41fbff-ad54-43d0-b8a6-64d15c596017"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:16:49.979428 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:49.979380    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee41fbff-ad54-43d0-b8a6-64d15c596017-kube-api-access-9bwp2" (OuterVolumeSpecName: "kube-api-access-9bwp2") pod "ee41fbff-ad54-43d0-b8a6-64d15c596017" (UID: "ee41fbff-ad54-43d0-b8a6-64d15c596017"). InnerVolumeSpecName "kube-api-access-9bwp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:16:50.079064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.079034    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bwp2\" (UniqueName: \"kubernetes.io/projected/ee41fbff-ad54-43d0-b8a6-64d15c596017-kube-api-access-9bwp2\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:50.079064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.079060    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee41fbff-ad54-43d0-b8a6-64d15c596017-tls-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:50.079064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.079071    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee41fbff-ad54-43d0-b8a6-64d15c596017-dshm\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:16:50.216225 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.216134    2560 generic.go:356] "Generic (PLEG): container finished" podID="ee41fbff-ad54-43d0-b8a6-64d15c596017" containerID="6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc" exitCode=0
Sep 10 00:16:50.216225 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.216179    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"
Sep 10 00:16:50.216437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.216227    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk" event={"ID":"ee41fbff-ad54-43d0-b8a6-64d15c596017","Type":"ContainerDied","Data":"6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc"}
Sep 10 00:16:50.216437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.216272    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk" event={"ID":"ee41fbff-ad54-43d0-b8a6-64d15c596017","Type":"ContainerDied","Data":"6d6962b16c2b05e4b04fb8ba206217da2a75d5a0a75f9205a16386a2e10a2ac7"}
Sep 10 00:16:50.216437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.216292    2560 scope.go:117] "RemoveContainer" containerID="6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc"
Sep 10 00:16:50.226569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.226550    2560 scope.go:117] "RemoveContainer" containerID="6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc"
Sep 10 00:16:50.226869 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:16:50.226849    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc\": container with ID starting with 6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc not found: ID does not exist" containerID="6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc"
Sep 10 00:16:50.226924 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.226877    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc"} err="failed to get container status \"6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc\": rpc error: code = NotFound desc = could not find container \"6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc\": container with ID starting with 6ab6b1e47abd7cd9d139a0922078eb876ff1f86ece1216dda7d9ae17abd7fcdc not found: ID does not exist"
Sep 10 00:16:50.239841 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.239820    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"]
Sep 10 00:16:50.242066 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.242047    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/e2e-conflict-a-9fc73175-kserve-5b4cb88886-g7lwk"]
Sep 10 00:16:50.341467 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:16:50.341434    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee41fbff-ad54-43d0-b8a6-64d15c596017" path="/var/lib/kubelet/pods/ee41fbff-ad54-43d0-b8a6-64d15c596017/volumes"
Sep 10 00:17:03.119469 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:03.119434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:06.124436 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:06.124399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:09.520955 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:09.520854    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:12.811812 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:12.811779    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:17:24.446054 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.446017    2560 generic.go:356] "Generic (PLEG): container finished" podID="753dc45a-aac1-4982-9050-2c245bf9d362" containerID="8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099" exitCode=0
Sep 10 00:17:24.446542 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.446070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" event={"ID":"753dc45a-aac1-4982-9050-2c245bf9d362","Type":"ContainerDied","Data":"8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099"}
Sep 10 00:17:24.446640 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.446622    2560 scope.go:117] "RemoveContainer" containerID="8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099"
Sep 10 00:17:24.448097 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.448066    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:17:24.448230 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.448098    2560 generic.go:356] "Generic (PLEG): container finished" podID="365e1102-10c5-403a-930a-649fb5bf24db" containerID="7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8" exitCode=0
Sep 10 00:17:24.448230 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.448142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" event={"ID":"365e1102-10c5-403a-930a-649fb5bf24db","Type":"ContainerDied","Data":"7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8"}
Sep 10 00:17:24.448230 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.448156    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:17:24.448230 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.448213    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:17:24.448560 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.448541    2560 scope.go:117] "RemoveContainer" containerID="7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8"
Sep 10 00:17:24.450084 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.450050    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:17:24.450169 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.450132    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:17:24.450210 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.450178    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:17:24.929330 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:24.929295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:25.029187 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.029154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:25.099457 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.099424    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:25.150190 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.150156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:25.154043 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.154004    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:17:25.457337 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.457299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" event={"ID":"753dc45a-aac1-4982-9050-2c245bf9d362","Type":"ContainerStarted","Data":"59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2"}
Sep 10 00:17:25.459186 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.459161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" event={"ID":"365e1102-10c5-403a-930a-649fb5bf24db","Type":"ContainerStarted","Data":"51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a"}
Sep 10 00:17:25.514236 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.514205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:25.878317 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.878273    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:17:25.879799 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.879758    2560 patch_prober.go:28] interesting pod/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 00:17:25.879926 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.879827    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 00:17:25.895951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.895890    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:17:25.897175 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.897141    2560 patch_prober.go:28] interesting pod/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 00:17:25.897314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.897203    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 00:17:25.972032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:25.971993    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:17:26.877920 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:26.877865    2560 patch_prober.go:28] interesting pod/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 00:17:26.878445 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:26.877979    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 00:17:26.896822 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:26.896782    2560 patch_prober.go:28] interesting pod/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 00:17:26.897028 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:26.896857    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 00:17:27.877909 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:27.877859    2560 patch_prober.go:28] interesting pod/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 00:17:27.878149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:27.877970    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 00:17:27.896781 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:27.896378    2560 patch_prober.go:28] interesting pod/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 00:17:27.896781 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:27.896444    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 00:17:28.878390 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:28.878346    2560 patch_prober.go:28] interesting pod/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 00:17:28.878868 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:28.878416    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 00:17:28.896725 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:28.896682    2560 patch_prober.go:28] interesting pod/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 00:17:28.897040 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:28.897009    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 00:17:29.877854 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:29.877816    2560 patch_prober.go:28] interesting pod/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 00:17:29.878154 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:29.878126    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 00:17:29.896089 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:29.896055    2560 patch_prober.go:28] interesting pod/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 00:17:29.896578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:29.896116    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 00:17:30.878110 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:30.877654    2560 patch_prober.go:28] interesting pod/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 00:17:30.878110 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:30.877718    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 00:17:30.896207 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:30.896162    2560 patch_prober.go:28] interesting pod/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 00:17:30.896711 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:30.896220    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 00:17:31.221571 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:31.221483    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:31.284280 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:31.284237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:31.500779 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:31.500699    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"]
Sep 10 00:17:31.500979 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:31.500952    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy" containerID="cri-o://51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a" gracePeriod=30
Sep 10 00:17:31.583196 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:31.583163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:31.881951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:31.881903    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:17:31.882242 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:31.882216    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:17:31.882892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:31.882878    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:17:32.221534 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:32.221433    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:36.754864 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.754840    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:17:36.801665 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.801629    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-istio-token\") pod \"365e1102-10c5-403a-930a-649fb5bf24db\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") "
Sep 10 00:17:36.801809 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.801678    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/365e1102-10c5-403a-930a-649fb5bf24db-istiod-ca-cert\") pod \"365e1102-10c5-403a-930a-649fb5bf24db\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") "
Sep 10 00:17:36.801809 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.801751    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-data\") pod \"365e1102-10c5-403a-930a-649fb5bf24db\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") "
Sep 10 00:17:36.801892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.801821    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-socket\") pod \"365e1102-10c5-403a-930a-649fb5bf24db\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") "
Sep 10 00:17:36.801892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.801881    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-certs\") pod \"365e1102-10c5-403a-930a-649fb5bf24db\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") "
Sep 10 00:17:36.802013 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.801910    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbg5g\" (UniqueName: \"kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-kube-api-access-pbg5g\") pod \"365e1102-10c5-403a-930a-649fb5bf24db\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") "
Sep 10 00:17:36.802109 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.802080    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-data" (OuterVolumeSpecName: "istio-data") pod "365e1102-10c5-403a-930a-649fb5bf24db" (UID: "365e1102-10c5-403a-930a-649fb5bf24db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:17:36.802307 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.802228    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "365e1102-10c5-403a-930a-649fb5bf24db" (UID: "365e1102-10c5-403a-930a-649fb5bf24db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:17:36.802307 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.802288    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/365e1102-10c5-403a-930a-649fb5bf24db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "365e1102-10c5-403a-930a-649fb5bf24db" (UID: "365e1102-10c5-403a-930a-649fb5bf24db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:17:36.802459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.802286    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "365e1102-10c5-403a-930a-649fb5bf24db" (UID: "365e1102-10c5-403a-930a-649fb5bf24db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:17:36.802459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.802358    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/365e1102-10c5-403a-930a-649fb5bf24db-istio-podinfo\") pod \"365e1102-10c5-403a-930a-649fb5bf24db\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") "
Sep 10 00:17:36.802459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.802417    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-envoy\") pod \"365e1102-10c5-403a-930a-649fb5bf24db\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") "
Sep 10 00:17:36.802459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.802443    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-credential-socket\") pod \"365e1102-10c5-403a-930a-649fb5bf24db\" (UID: \"365e1102-10c5-403a-930a-649fb5bf24db\") "
Sep 10 00:17:36.802887 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.802867    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:36.803081 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.803057    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:36.803193 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.803083    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/365e1102-10c5-403a-930a-649fb5bf24db-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:36.803193 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.803097    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:36.803193 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.802906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "365e1102-10c5-403a-930a-649fb5bf24db" (UID: "365e1102-10c5-403a-930a-649fb5bf24db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:17:36.804355 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.804333    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-istio-token" (OuterVolumeSpecName: "istio-token") pod "365e1102-10c5-403a-930a-649fb5bf24db" (UID: "365e1102-10c5-403a-930a-649fb5bf24db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:17:36.804563 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.804541    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-kube-api-access-pbg5g" (OuterVolumeSpecName: "kube-api-access-pbg5g") pod "365e1102-10c5-403a-930a-649fb5bf24db" (UID: "365e1102-10c5-403a-930a-649fb5bf24db"). InnerVolumeSpecName "kube-api-access-pbg5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:17:36.804627 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.804575    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "365e1102-10c5-403a-930a-649fb5bf24db" (UID: "365e1102-10c5-403a-930a-649fb5bf24db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:17:36.804769 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.804753    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/365e1102-10c5-403a-930a-649fb5bf24db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "365e1102-10c5-403a-930a-649fb5bf24db" (UID: "365e1102-10c5-403a-930a-649fb5bf24db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:17:36.904064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.904023    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbg5g\" (UniqueName: \"kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-kube-api-access-pbg5g\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:36.904064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.904062    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/365e1102-10c5-403a-930a-649fb5bf24db-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:36.904064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.904072    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:36.904064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.904081    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/365e1102-10c5-403a-930a-649fb5bf24db-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:36.904403 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:36.904090    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/365e1102-10c5-403a-930a-649fb5bf24db-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:37.547526 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.547488    2560 generic.go:356] "Generic (PLEG): container finished" podID="365e1102-10c5-403a-930a-649fb5bf24db" containerID="51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a" exitCode=0
Sep 10 00:17:37.547708 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.547566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" event={"ID":"365e1102-10c5-403a-930a-649fb5bf24db","Type":"ContainerDied","Data":"51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a"}
Sep 10 00:17:37.547708 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.547579    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"
Sep 10 00:17:37.547708 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.547642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8" event={"ID":"365e1102-10c5-403a-930a-649fb5bf24db","Type":"ContainerDied","Data":"98a7fd8d02440f06fa72bf4bea0060c714500e4c498f877bffa77103a0f99732"}
Sep 10 00:17:37.547708 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.547666    2560 scope.go:117] "RemoveContainer" containerID="51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a"
Sep 10 00:17:37.558156 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.558141    2560 scope.go:117] "RemoveContainer" containerID="7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8"
Sep 10 00:17:37.567012 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.566991    2560 scope.go:117] "RemoveContainer" containerID="51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a"
Sep 10 00:17:37.567304 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:17:37.567282    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a\": container with ID starting with 51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a not found: ID does not exist" containerID="51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a"
Sep 10 00:17:37.567387 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.567310    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a"} err="failed to get container status \"51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a\": rpc error: code = NotFound desc = could not find container \"51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a\": container with ID starting with 51438082e9f3e07fcc1525c8f6e3dd94c3d4da1ce019f330a9687506d366a38a not found: ID does not exist"
Sep 10 00:17:37.567387 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.567332    2560 scope.go:117] "RemoveContainer" containerID="7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8"
Sep 10 00:17:37.567597 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:17:37.567572    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8\": container with ID starting with 7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8 not found: ID does not exist" containerID="7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8"
Sep 10 00:17:37.567704 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.567599    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8"} err="failed to get container status \"7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8\": rpc error: code = NotFound desc = could not find container \"7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8\": container with ID starting with 7e918f57a6bfa37a526f05eab20440c2ca269ad20cace4baa6e56dd4620542b8 not found: ID does not exist"
Sep 10 00:17:37.571848 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.571820    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"]
Sep 10 00:17:37.575407 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:37.575386    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8"]
Sep 10 00:17:38.340438 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:38.340402    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="365e1102-10c5-403a-930a-649fb5bf24db" path="/var/lib/kubelet/pods/365e1102-10c5-403a-930a-649fb5bf24db/volumes"
Sep 10 00:17:47.339514 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:47.339472    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:47.401348 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:47.401319    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:47.501483 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:47.501448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:47.560024 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:47.559992    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:47.890224 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:47.890191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:53.520650 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:53.520617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:53.574984 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:53.574925    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:53.781004 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:53.780910    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"]
Sep 10 00:17:53.781170 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:53.781146    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy" containerID="cri-o://59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2" gracePeriod=30
Sep 10 00:17:53.797608 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:53.797578    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:54.326417 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:54.326385    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:17:59.035809 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.035783    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:17:59.142274 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142240    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/753dc45a-aac1-4982-9050-2c245bf9d362-istiod-ca-cert\") pod \"753dc45a-aac1-4982-9050-2c245bf9d362\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") "
Sep 10 00:17:59.142449 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142292    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-envoy\") pod \"753dc45a-aac1-4982-9050-2c245bf9d362\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") "
Sep 10 00:17:59.142449 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142340    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-istio-token\") pod \"753dc45a-aac1-4982-9050-2c245bf9d362\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") "
Sep 10 00:17:59.142449 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142355    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-certs\") pod \"753dc45a-aac1-4982-9050-2c245bf9d362\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") "
Sep 10 00:17:59.142449 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142383    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/753dc45a-aac1-4982-9050-2c245bf9d362-istio-podinfo\") pod \"753dc45a-aac1-4982-9050-2c245bf9d362\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") "
Sep 10 00:17:59.142653 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142466    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-data\") pod \"753dc45a-aac1-4982-9050-2c245bf9d362\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") "
Sep 10 00:17:59.142653 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142507    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-credential-socket\") pod \"753dc45a-aac1-4982-9050-2c245bf9d362\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") "
Sep 10 00:17:59.142759 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142674    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7xfw\" (UniqueName: \"kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-kube-api-access-z7xfw\") pod \"753dc45a-aac1-4982-9050-2c245bf9d362\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") "
Sep 10 00:17:59.142759 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142679    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "753dc45a-aac1-4982-9050-2c245bf9d362" (UID: "753dc45a-aac1-4982-9050-2c245bf9d362"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:17:59.142759 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142704    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753dc45a-aac1-4982-9050-2c245bf9d362-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "753dc45a-aac1-4982-9050-2c245bf9d362" (UID: "753dc45a-aac1-4982-9050-2c245bf9d362"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:17:59.142923 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142799    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "753dc45a-aac1-4982-9050-2c245bf9d362" (UID: "753dc45a-aac1-4982-9050-2c245bf9d362"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:17:59.142923 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142815    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-socket\") pod \"753dc45a-aac1-4982-9050-2c245bf9d362\" (UID: \"753dc45a-aac1-4982-9050-2c245bf9d362\") "
Sep 10 00:17:59.143063 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.142981    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "753dc45a-aac1-4982-9050-2c245bf9d362" (UID: "753dc45a-aac1-4982-9050-2c245bf9d362"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:17:59.143313 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.143286    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:59.143453 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.143318    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:59.143453 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.143335    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/753dc45a-aac1-4982-9050-2c245bf9d362-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:59.143453 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.143289    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-data" (OuterVolumeSpecName: "istio-data") pod "753dc45a-aac1-4982-9050-2c245bf9d362" (UID: "753dc45a-aac1-4982-9050-2c245bf9d362"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:17:59.143453 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.143348    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:59.145016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.144988    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-kube-api-access-z7xfw" (OuterVolumeSpecName: "kube-api-access-z7xfw") pod "753dc45a-aac1-4982-9050-2c245bf9d362" (UID: "753dc45a-aac1-4982-9050-2c245bf9d362"). InnerVolumeSpecName "kube-api-access-z7xfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:17:59.145135 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.145116    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "753dc45a-aac1-4982-9050-2c245bf9d362" (UID: "753dc45a-aac1-4982-9050-2c245bf9d362"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:17:59.145204 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.145152    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-istio-token" (OuterVolumeSpecName: "istio-token") pod "753dc45a-aac1-4982-9050-2c245bf9d362" (UID: "753dc45a-aac1-4982-9050-2c245bf9d362"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:17:59.145320 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.145295    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/753dc45a-aac1-4982-9050-2c245bf9d362-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "753dc45a-aac1-4982-9050-2c245bf9d362" (UID: "753dc45a-aac1-4982-9050-2c245bf9d362"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:17:59.244255 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.244220    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7xfw\" (UniqueName: \"kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-kube-api-access-z7xfw\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:59.244255 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.244250    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:59.244461 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.244263    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/753dc45a-aac1-4982-9050-2c245bf9d362-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:59.244461 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.244275    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/753dc45a-aac1-4982-9050-2c245bf9d362-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:59.244461 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.244285    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/753dc45a-aac1-4982-9050-2c245bf9d362-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:17:59.688868 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.688833    2560 generic.go:356] "Generic (PLEG): container finished" podID="753dc45a-aac1-4982-9050-2c245bf9d362" containerID="59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2" exitCode=0
Sep 10 00:17:59.689074 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.688888    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"
Sep 10 00:17:59.689074 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.688919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" event={"ID":"753dc45a-aac1-4982-9050-2c245bf9d362","Type":"ContainerDied","Data":"59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2"}
Sep 10 00:17:59.689074 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.688992    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh" event={"ID":"753dc45a-aac1-4982-9050-2c245bf9d362","Type":"ContainerDied","Data":"82e850cba48ffb9e4b620e5d0074d5cb685d95b2a64b496c11c293a78bfa25cd"}
Sep 10 00:17:59.689074 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.689023    2560 scope.go:117] "RemoveContainer" containerID="59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2"
Sep 10 00:17:59.701223 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.701190    2560 scope.go:117] "RemoveContainer" containerID="8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099"
Sep 10 00:17:59.709824 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.709801    2560 scope.go:117] "RemoveContainer" containerID="59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2"
Sep 10 00:17:59.710144 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:17:59.710125    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2\": container with ID starting with 59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2 not found: ID does not exist" containerID="59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2"
Sep 10 00:17:59.710227 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.710155    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2"} err="failed to get container status \"59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2\": rpc error: code = NotFound desc = could not find container \"59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2\": container with ID starting with 59c82ab8812469f2a016a558b91c39fe22b58d224f06ad172d72d80dd973abe2 not found: ID does not exist"
Sep 10 00:17:59.710227 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.710171    2560 scope.go:117] "RemoveContainer" containerID="8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099"
Sep 10 00:17:59.710475 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:17:59.710460    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099\": container with ID starting with 8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099 not found: ID does not exist" containerID="8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099"
Sep 10 00:17:59.710511 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.710479    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099"} err="failed to get container status \"8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099\": rpc error: code = NotFound desc = could not find container \"8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099\": container with ID starting with 8e420ef95d6bd543166647062a91794661438d94e826ca0983f70bcf92ce6099 not found: ID does not exist"
Sep 10 00:17:59.712315 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.712291    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"]
Sep 10 00:17:59.715074 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:17:59.715050    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh"]
Sep 10 00:18:00.202242 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:00.202193    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:18:00.341122 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:00.341092    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" path="/var/lib/kubelet/pods/753dc45a-aac1-4982-9050-2c245bf9d362/volumes"
Sep 10 00:18:04.494781 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.494746    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"]
Sep 10 00:18:04.495548 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.495511    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v" podUID="6b1906d6-5143-4fd2-866c-267ffe7a59bd" containerName="maas-api" containerID="cri-o://cab2b1062d0a0e7d4744548ae50df23b2a9a4e9faa850e5130d08d4fd2dfa138" gracePeriod=30
Sep 10 00:18:04.522212 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.522178    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:04.600724 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.600692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:04.657483 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.657451    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:04.715626 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.715588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:04.721475 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.721448    2560 generic.go:356] "Generic (PLEG): container finished" podID="6b1906d6-5143-4fd2-866c-267ffe7a59bd" containerID="cab2b1062d0a0e7d4744548ae50df23b2a9a4e9faa850e5130d08d4fd2dfa138" exitCode=0
Sep 10 00:18:04.721666 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.721506    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v" event={"ID":"6b1906d6-5143-4fd2-866c-267ffe7a59bd","Type":"ContainerDied","Data":"cab2b1062d0a0e7d4744548ae50df23b2a9a4e9faa850e5130d08d4fd2dfa138"}
Sep 10 00:18:04.753538 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.753472    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:18:04.905525 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.904393    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sngmb\" (UniqueName: \"kubernetes.io/projected/6b1906d6-5143-4fd2-866c-267ffe7a59bd-kube-api-access-sngmb\") pod \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") "
Sep 10 00:18:04.905525 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.904466    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-maas-api-tls\") pod \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") "
Sep 10 00:18:04.905525 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.904509    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1906d6-5143-4fd2-866c-267ffe7a59bd-openshift-service-ca\") pod \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") "
Sep 10 00:18:04.905525 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.904536    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-metrics-certs\") pod \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\" (UID: \"6b1906d6-5143-4fd2-866c-267ffe7a59bd\") "
Sep 10 00:18:04.909655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.909252    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b1906d6-5143-4fd2-866c-267ffe7a59bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b1906d6-5143-4fd2-866c-267ffe7a59bd" (UID: "6b1906d6-5143-4fd2-866c-267ffe7a59bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:18:04.917410 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.917372    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6b1906d6-5143-4fd2-866c-267ffe7a59bd" (UID: "6b1906d6-5143-4fd2-866c-267ffe7a59bd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:18:04.920433 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.920403    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b1906d6-5143-4fd2-866c-267ffe7a59bd" (UID: "6b1906d6-5143-4fd2-866c-267ffe7a59bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:18:04.936890 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:04.936837    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1906d6-5143-4fd2-866c-267ffe7a59bd-kube-api-access-sngmb" (OuterVolumeSpecName: "kube-api-access-sngmb") pod "6b1906d6-5143-4fd2-866c-267ffe7a59bd" (UID: "6b1906d6-5143-4fd2-866c-267ffe7a59bd"). InnerVolumeSpecName "kube-api-access-sngmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:18:05.005508 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:05.005402    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sngmb\" (UniqueName: \"kubernetes.io/projected/6b1906d6-5143-4fd2-866c-267ffe7a59bd-kube-api-access-sngmb\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:05.005508 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:05.005440    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:05.005508 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:05.005453    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1906d6-5143-4fd2-866c-267ffe7a59bd-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:05.005508 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:05.005464    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b1906d6-5143-4fd2-866c-267ffe7a59bd-metrics-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:05.055894 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:05.055852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:05.728619 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:05.728587    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"
Sep 10 00:18:05.729080 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:05.728626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v" event={"ID":"6b1906d6-5143-4fd2-866c-267ffe7a59bd","Type":"ContainerDied","Data":"197933784a7fe5172d1ff7ab732d45b37420a3673bde42b85fd22700c8b795e7"}
Sep 10 00:18:05.729080 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:05.728696    2560 scope.go:117] "RemoveContainer" containerID="cab2b1062d0a0e7d4744548ae50df23b2a9a4e9faa850e5130d08d4fd2dfa138"
Sep 10 00:18:05.752096 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:05.752069    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"]
Sep 10 00:18:05.754134 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:05.754113    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1d36d9-556bdf96f8-5jz4v"]
Sep 10 00:18:06.340886 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:06.340847    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b1906d6-5143-4fd2-866c-267ffe7a59bd" path="/var/lib/kubelet/pods/6b1906d6-5143-4fd2-866c-267ffe7a59bd/volumes"
Sep 10 00:18:10.930486 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:10.930451    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:11.029794 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:11.029759    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:11.164066 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:11.164034    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"]
Sep 10 00:18:11.164353 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:11.164323    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy" containerID="cri-o://c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b" gracePeriod=30
Sep 10 00:18:11.203056 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:11.202985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:11.700379 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:11.700348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:16.419551 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.419523    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:18:16.514760 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.514677    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-credential-socket\") pod \"2de27466-3553-4492-842c-21c42ce7fb99\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") "
Sep 10 00:18:16.514760 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.514741    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-certs\") pod \"2de27466-3553-4492-842c-21c42ce7fb99\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") "
Sep 10 00:18:16.515016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.514772    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-envoy\") pod \"2de27466-3553-4492-842c-21c42ce7fb99\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") "
Sep 10 00:18:16.515016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.514809    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-istio-token\") pod \"2de27466-3553-4492-842c-21c42ce7fb99\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") "
Sep 10 00:18:16.515016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.514824    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7p24\" (UniqueName: \"kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-kube-api-access-f7p24\") pod \"2de27466-3553-4492-842c-21c42ce7fb99\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") "
Sep 10 00:18:16.515016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.514843    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-data\") pod \"2de27466-3553-4492-842c-21c42ce7fb99\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") "
Sep 10 00:18:16.515016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.514863    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2de27466-3553-4492-842c-21c42ce7fb99-istio-podinfo\") pod \"2de27466-3553-4492-842c-21c42ce7fb99\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") "
Sep 10 00:18:16.515016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.514913    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2de27466-3553-4492-842c-21c42ce7fb99-istiod-ca-cert\") pod \"2de27466-3553-4492-842c-21c42ce7fb99\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") "
Sep 10 00:18:16.515016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.514978    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2de27466-3553-4492-842c-21c42ce7fb99" (UID: "2de27466-3553-4492-842c-21c42ce7fb99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:18:16.515016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.515017    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-socket\") pod \"2de27466-3553-4492-842c-21c42ce7fb99\" (UID: \"2de27466-3553-4492-842c-21c42ce7fb99\") "
Sep 10 00:18:16.515438 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.515025    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2de27466-3553-4492-842c-21c42ce7fb99" (UID: "2de27466-3553-4492-842c-21c42ce7fb99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:18:16.515438 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.515150    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-data" (OuterVolumeSpecName: "istio-data") pod "2de27466-3553-4492-842c-21c42ce7fb99" (UID: "2de27466-3553-4492-842c-21c42ce7fb99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:18:16.515438 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.515283    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2de27466-3553-4492-842c-21c42ce7fb99" (UID: "2de27466-3553-4492-842c-21c42ce7fb99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:18:16.515563 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.515465    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de27466-3553-4492-842c-21c42ce7fb99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2de27466-3553-4492-842c-21c42ce7fb99" (UID: "2de27466-3553-4492-842c-21c42ce7fb99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:18:16.515616 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.515575    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:16.515616 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.515597    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:16.515616 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.515613    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:16.515743 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.515627    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:16.515743 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.515639    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2de27466-3553-4492-842c-21c42ce7fb99-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:16.516882 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.516855    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-kube-api-access-f7p24" (OuterVolumeSpecName: "kube-api-access-f7p24") pod "2de27466-3553-4492-842c-21c42ce7fb99" (UID: "2de27466-3553-4492-842c-21c42ce7fb99"). InnerVolumeSpecName "kube-api-access-f7p24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:18:16.517081 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.517064    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-istio-token" (OuterVolumeSpecName: "istio-token") pod "2de27466-3553-4492-842c-21c42ce7fb99" (UID: "2de27466-3553-4492-842c-21c42ce7fb99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:18:16.517315 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.517295    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2de27466-3553-4492-842c-21c42ce7fb99" (UID: "2de27466-3553-4492-842c-21c42ce7fb99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:18:16.517315 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.517306    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2de27466-3553-4492-842c-21c42ce7fb99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2de27466-3553-4492-842c-21c42ce7fb99" (UID: "2de27466-3553-4492-842c-21c42ce7fb99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:18:16.617071 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.617045    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2de27466-3553-4492-842c-21c42ce7fb99-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:16.617071 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.617070    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:16.617238 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.617080    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7p24\" (UniqueName: \"kubernetes.io/projected/2de27466-3553-4492-842c-21c42ce7fb99-kube-api-access-f7p24\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:16.617238 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.617090    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2de27466-3553-4492-842c-21c42ce7fb99-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:16.796411 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.796321    2560 generic.go:356] "Generic (PLEG): container finished" podID="2de27466-3553-4492-842c-21c42ce7fb99" containerID="c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b" exitCode=0
Sep 10 00:18:16.796411 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.796367    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"
Sep 10 00:18:16.796589 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.796405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" event={"ID":"2de27466-3553-4492-842c-21c42ce7fb99","Type":"ContainerDied","Data":"c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b"}
Sep 10 00:18:16.796589 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.796457    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw" event={"ID":"2de27466-3553-4492-842c-21c42ce7fb99","Type":"ContainerDied","Data":"3d7698cac8313483f520fbff51f5f76f9d14172f392c92b115132ce514394ca2"}
Sep 10 00:18:16.796589 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.796481    2560 scope.go:117] "RemoveContainer" containerID="c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b"
Sep 10 00:18:16.805973 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.805956    2560 scope.go:117] "RemoveContainer" containerID="5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe"
Sep 10 00:18:16.813978 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.813963    2560 scope.go:117] "RemoveContainer" containerID="c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b"
Sep 10 00:18:16.814268 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:18:16.814224    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b\": container with ID starting with c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b not found: ID does not exist" containerID="c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b"
Sep 10 00:18:16.814268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.814253    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b"} err="failed to get container status \"c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b\": rpc error: code = NotFound desc = could not find container \"c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b\": container with ID starting with c361b5b5ca669547eef9e5f70f1af395c8f453f089f8ef56cd5bb0c7e0c0265b not found: ID does not exist"
Sep 10 00:18:16.814441 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.814277    2560 scope.go:117] "RemoveContainer" containerID="5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe"
Sep 10 00:18:16.814713 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:18:16.814651    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe\": container with ID starting with 5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe not found: ID does not exist" containerID="5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe"
Sep 10 00:18:16.814859 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.814756    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe"} err="failed to get container status \"5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe\": rpc error: code = NotFound desc = could not find container \"5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe\": container with ID starting with 5d6717b802ad4169ba26934f4becae244874613db19f7b72e0e2175e80e018fe not found: ID does not exist"
Sep 10 00:18:16.817350 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.817330    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"]
Sep 10 00:18:16.822766 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:16.822744    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw"]
Sep 10 00:18:18.339736 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:18.339701    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2de27466-3553-4492-842c-21c42ce7fb99" path="/var/lib/kubelet/pods/2de27466-3553-4492-842c-21c42ce7fb99/volumes"
Sep 10 00:18:21.726197 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:21.726164    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:21.826181 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:21.826147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:21.945575 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:21.945538    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"]
Sep 10 00:18:21.945829 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:21.945802    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr" podUID="0a9c5fd1-7ab0-412d-a18a-e41398e81e1d" containerName="maas-api" containerID="cri-o://4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d" gracePeriod=30
Sep 10 00:18:21.963296 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:21.963237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:22.179671 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.179629    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:22.198605 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.198582    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:18:22.242113 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.242081    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:22.273648 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.273622    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l86n\" (UniqueName: \"kubernetes.io/projected/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-kube-api-access-4l86n\") pod \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") "
Sep 10 00:18:22.273780 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.273671    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-maas-api-tls\") pod \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") "
Sep 10 00:18:22.273780 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.273722    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-metrics-certs\") pod \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") "
Sep 10 00:18:22.273780 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.273773    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-openshift-service-ca\") pod \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\" (UID: \"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d\") "
Sep 10 00:18:22.274206 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.274175    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a9c5fd1-7ab0-412d-a18a-e41398e81e1d" (UID: "0a9c5fd1-7ab0-412d-a18a-e41398e81e1d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:18:22.275729 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.275702    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-kube-api-access-4l86n" (OuterVolumeSpecName: "kube-api-access-4l86n") pod "0a9c5fd1-7ab0-412d-a18a-e41398e81e1d" (UID: "0a9c5fd1-7ab0-412d-a18a-e41398e81e1d"). InnerVolumeSpecName "kube-api-access-4l86n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:18:22.275729 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.275715    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0a9c5fd1-7ab0-412d-a18a-e41398e81e1d" (UID: "0a9c5fd1-7ab0-412d-a18a-e41398e81e1d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:18:22.275870 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.275794    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a9c5fd1-7ab0-412d-a18a-e41398e81e1d" (UID: "0a9c5fd1-7ab0-412d-a18a-e41398e81e1d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:18:22.297492 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.297469    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:22.377011 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.376165    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-metrics-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:22.377011 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.376197    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:22.377011 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.376212    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l86n\" (UniqueName: \"kubernetes.io/projected/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-kube-api-access-4l86n\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:22.377011 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.376226    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:22.585179 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.585141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:22.832063 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.832029    2560 generic.go:356] "Generic (PLEG): container finished" podID="0a9c5fd1-7ab0-412d-a18a-e41398e81e1d" containerID="4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d" exitCode=0
Sep 10 00:18:22.832477 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.832076    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"
Sep 10 00:18:22.832477 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.832117    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr" event={"ID":"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d","Type":"ContainerDied","Data":"4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d"}
Sep 10 00:18:22.832477 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.832177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr" event={"ID":"0a9c5fd1-7ab0-412d-a18a-e41398e81e1d","Type":"ContainerDied","Data":"01d1656c34864fbdd24ed732146124625752d8bb3bbe427e75407db756d37fb5"}
Sep 10 00:18:22.832477 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.832206    2560 scope.go:117] "RemoveContainer" containerID="4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d"
Sep 10 00:18:22.841672 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.841655    2560 scope.go:117] "RemoveContainer" containerID="4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d"
Sep 10 00:18:22.841996 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:18:22.841960    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d\": container with ID starting with 4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d not found: ID does not exist" containerID="4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d"
Sep 10 00:18:22.842100 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.842009    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d"} err="failed to get container status \"4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d\": rpc error: code = NotFound desc = could not find container \"4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d\": container with ID starting with 4c9ff972d30005a2738b9475a4d5ab44aa8d466d8e199c515b8f88377dbe601d not found: ID does not exist"
Sep 10 00:18:22.851366 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.851081    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"]
Sep 10 00:18:22.854476 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:22.854450    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-870d44-554bdc9595-795lr"]
Sep 10 00:18:24.340871 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:24.340824    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a9c5fd1-7ab0-412d-a18a-e41398e81e1d" path="/var/lib/kubelet/pods/0a9c5fd1-7ab0-412d-a18a-e41398e81e1d/volumes"
Sep 10 00:18:28.222249 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:28.222213    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:28.280867 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:28.280832    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:28.452281 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:28.452249    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"]
Sep 10 00:18:28.452477 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:28.452454    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy" containerID="cri-o://64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6" gracePeriod=30
Sep 10 00:18:28.467776 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:28.467730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:31.209396 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:31.209360    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 00:18:31.209784 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:31.209426    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 00:18:33.179604 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.179567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:33.480521 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.480477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:33.708361 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.708337    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:18:33.788997 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.788905    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-socket\") pod \"6a26bf91-f389-4522-8d3d-173db5feb1fc\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") "
Sep 10 00:18:33.788997 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.788969    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx5ft\" (UniqueName: \"kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-kube-api-access-kx5ft\") pod \"6a26bf91-f389-4522-8d3d-173db5feb1fc\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") "
Sep 10 00:18:33.789209 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.789019    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-data\") pod \"6a26bf91-f389-4522-8d3d-173db5feb1fc\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") "
Sep 10 00:18:33.789209 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.789077    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-token\") pod \"6a26bf91-f389-4522-8d3d-173db5feb1fc\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") "
Sep 10 00:18:33.789209 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.789149    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-envoy\") pod \"6a26bf91-f389-4522-8d3d-173db5feb1fc\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") "
Sep 10 00:18:33.789209 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.789164    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a26bf91-f389-4522-8d3d-173db5feb1fc" (UID: "6a26bf91-f389-4522-8d3d-173db5feb1fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:18:33.789209 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.789178    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-credential-socket\") pod \"6a26bf91-f389-4522-8d3d-173db5feb1fc\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") "
Sep 10 00:18:33.789465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.789231    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-podinfo\") pod \"6a26bf91-f389-4522-8d3d-173db5feb1fc\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") "
Sep 10 00:18:33.789465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.789296    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a26bf91-f389-4522-8d3d-173db5feb1fc-istiod-ca-cert\") pod \"6a26bf91-f389-4522-8d3d-173db5feb1fc\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") "
Sep 10 00:18:33.789465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.789320    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-certs\") pod \"6a26bf91-f389-4522-8d3d-173db5feb1fc\" (UID: \"6a26bf91-f389-4522-8d3d-173db5feb1fc\") "
Sep 10 00:18:33.789465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.789338    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a26bf91-f389-4522-8d3d-173db5feb1fc" (UID: "6a26bf91-f389-4522-8d3d-173db5feb1fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:18:33.790041 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.789976    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a26bf91-f389-4522-8d3d-173db5feb1fc" (UID: "6a26bf91-f389-4522-8d3d-173db5feb1fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:18:33.790156 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.790052    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a26bf91-f389-4522-8d3d-173db5feb1fc" (UID: "6a26bf91-f389-4522-8d3d-173db5feb1fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:18:33.790156 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.790124    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a26bf91-f389-4522-8d3d-173db5feb1fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a26bf91-f389-4522-8d3d-173db5feb1fc" (UID: "6a26bf91-f389-4522-8d3d-173db5feb1fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:18:33.798444 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.791113    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a26bf91-f389-4522-8d3d-173db5feb1fc-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:33.798444 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.791147    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:33.798444 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.791162    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:33.798444 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.791176    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:33.798444 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.791190    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:33.798444 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.791484    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-kube-api-access-kx5ft" (OuterVolumeSpecName: "kube-api-access-kx5ft") pod "6a26bf91-f389-4522-8d3d-173db5feb1fc" (UID: "6a26bf91-f389-4522-8d3d-173db5feb1fc"). InnerVolumeSpecName "kube-api-access-kx5ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:18:33.799827 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.799803    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a26bf91-f389-4522-8d3d-173db5feb1fc" (UID: "6a26bf91-f389-4522-8d3d-173db5feb1fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:18:33.800015 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.799999    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a26bf91-f389-4522-8d3d-173db5feb1fc" (UID: "6a26bf91-f389-4522-8d3d-173db5feb1fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:18:33.800510 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.800490    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a26bf91-f389-4522-8d3d-173db5feb1fc" (UID: "6a26bf91-f389-4522-8d3d-173db5feb1fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:18:33.892129 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.892099    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx5ft\" (UniqueName: \"kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-kube-api-access-kx5ft\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:33.892129 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.892127    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:33.892288 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.892136    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:33.892288 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.892144    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a26bf91-f389-4522-8d3d-173db5feb1fc-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:18:33.900039 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.900009    2560 generic.go:356] "Generic (PLEG): container finished" podID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerID="64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6" exitCode=0
Sep 10 00:18:33.900147 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.900061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" event={"ID":"6a26bf91-f389-4522-8d3d-173db5feb1fc","Type":"ContainerDied","Data":"64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6"}
Sep 10 00:18:33.900147 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.900081    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"
Sep 10 00:18:33.900219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.900151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs" event={"ID":"6a26bf91-f389-4522-8d3d-173db5feb1fc","Type":"ContainerDied","Data":"d875022e6d765ee40356858644a61f29836fd3a095a622b40950f31f6a41d2ea"}
Sep 10 00:18:33.900219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.900184    2560 scope.go:117] "RemoveContainer" containerID="64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6"
Sep 10 00:18:33.909615 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.909594    2560 scope.go:117] "RemoveContainer" containerID="7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b"
Sep 10 00:18:33.918049 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.918031    2560 scope.go:117] "RemoveContainer" containerID="64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6"
Sep 10 00:18:33.918314 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:18:33.918294    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6\": container with ID starting with 64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6 not found: ID does not exist" containerID="64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6"
Sep 10 00:18:33.918386 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.918326    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6"} err="failed to get container status \"64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6\": rpc error: code = NotFound desc = could not find container \"64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6\": container with ID starting with 64bcc7088e6553ed530def5e2fd2e0c259ca435a25969df5f08ef4e03c6e7cd6 not found: ID does not exist"
Sep 10 00:18:33.918386 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.918350    2560 scope.go:117] "RemoveContainer" containerID="7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b"
Sep 10 00:18:33.918620 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:18:33.918604    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b\": container with ID starting with 7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b not found: ID does not exist" containerID="7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b"
Sep 10 00:18:33.918660 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.918625    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b"} err="failed to get container status \"7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b\": rpc error: code = NotFound desc = could not find container \"7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b\": container with ID starting with 7d52509fa1e950b2d9d8232cfc234d23912c246c04ab38e36c80dbf15ec2365b not found: ID does not exist"
Sep 10 00:18:33.923745 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.923723    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"]
Sep 10 00:18:33.925758 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:33.925738    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs"]
Sep 10 00:18:34.340899 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:34.340869    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" path="/var/lib/kubelet/pods/6a26bf91-f389-4522-8d3d-173db5feb1fc/volumes"
Sep 10 00:18:38.231257 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:38.231214    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:46.438758 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:46.438726    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:18:46.440918 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:46.440897    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:18:48.848977 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:48.848916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:48.946762 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:48.946733    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:49.039167 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:49.039130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:49.101626 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:49.101552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:49.435546 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:49.435447    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:51.001347 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:51.001303    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:18:55.130887 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:55.130790    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:18:55.404315 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:55.404220    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"]
Sep 10 00:18:56.036757 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:56.036715    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy" containerID="cri-o://b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222" gracePeriod=30
Sep 10 00:18:56.493469 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:18:56.493433    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:01.282864 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.282829    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:19:01.359897 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.359817    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-credential-socket\") pod \"cae0a688-0af0-4eb1-89d1-677f0389ba99\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") "
Sep 10 00:19:01.359897 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.359872    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-socket\") pod \"cae0a688-0af0-4eb1-89d1-677f0389ba99\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") "
Sep 10 00:19:01.360172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.359914    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-certs\") pod \"cae0a688-0af0-4eb1-89d1-677f0389ba99\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") "
Sep 10 00:19:01.360172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360037    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-podinfo\") pod \"cae0a688-0af0-4eb1-89d1-677f0389ba99\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") "
Sep 10 00:19:01.360172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360091    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-data\") pod \"cae0a688-0af0-4eb1-89d1-677f0389ba99\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") "
Sep 10 00:19:01.360172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360120    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-envoy\") pod \"cae0a688-0af0-4eb1-89d1-677f0389ba99\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") "
Sep 10 00:19:01.360172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360147    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cae0a688-0af0-4eb1-89d1-677f0389ba99-istiod-ca-cert\") pod \"cae0a688-0af0-4eb1-89d1-677f0389ba99\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") "
Sep 10 00:19:01.360450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360177    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cae0a688-0af0-4eb1-89d1-677f0389ba99" (UID: "cae0a688-0af0-4eb1-89d1-677f0389ba99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:19:01.360450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360185    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpfzr\" (UniqueName: \"kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-kube-api-access-jpfzr\") pod \"cae0a688-0af0-4eb1-89d1-677f0389ba99\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") "
Sep 10 00:19:01.360450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360189    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cae0a688-0af0-4eb1-89d1-677f0389ba99" (UID: "cae0a688-0af0-4eb1-89d1-677f0389ba99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:19:01.360450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360215    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cae0a688-0af0-4eb1-89d1-677f0389ba99" (UID: "cae0a688-0af0-4eb1-89d1-677f0389ba99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:19:01.360450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360295    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-token\") pod \"cae0a688-0af0-4eb1-89d1-677f0389ba99\" (UID: \"cae0a688-0af0-4eb1-89d1-677f0389ba99\") "
Sep 10 00:19:01.360450 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360391    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-data" (OuterVolumeSpecName: "istio-data") pod "cae0a688-0af0-4eb1-89d1-677f0389ba99" (UID: "cae0a688-0af0-4eb1-89d1-677f0389ba99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:19:01.360787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360536    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cae0a688-0af0-4eb1-89d1-677f0389ba99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cae0a688-0af0-4eb1-89d1-677f0389ba99" (UID: "cae0a688-0af0-4eb1-89d1-677f0389ba99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:19:01.360787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360731    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:01.360787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360747    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:01.360787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360763    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cae0a688-0af0-4eb1-89d1-677f0389ba99-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:01.360787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360778    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:01.361046 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.360793    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:01.362363 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.362330    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-kube-api-access-jpfzr" (OuterVolumeSpecName: "kube-api-access-jpfzr") pod "cae0a688-0af0-4eb1-89d1-677f0389ba99" (UID: "cae0a688-0af0-4eb1-89d1-677f0389ba99"). InnerVolumeSpecName "kube-api-access-jpfzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:19:01.362474 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.362404    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-token" (OuterVolumeSpecName: "istio-token") pod "cae0a688-0af0-4eb1-89d1-677f0389ba99" (UID: "cae0a688-0af0-4eb1-89d1-677f0389ba99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:19:01.362630 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.362605    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cae0a688-0af0-4eb1-89d1-677f0389ba99" (UID: "cae0a688-0af0-4eb1-89d1-677f0389ba99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:19:01.362739 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.362607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cae0a688-0af0-4eb1-89d1-677f0389ba99" (UID: "cae0a688-0af0-4eb1-89d1-677f0389ba99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:19:01.461504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.461469    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:01.461504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.461502    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:01.461504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.461512    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cae0a688-0af0-4eb1-89d1-677f0389ba99-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:01.461766 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:01.461521    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpfzr\" (UniqueName: \"kubernetes.io/projected/cae0a688-0af0-4eb1-89d1-677f0389ba99-kube-api-access-jpfzr\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:02.078447 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.078397    2560 generic.go:356] "Generic (PLEG): container finished" podID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerID="b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222" exitCode=0
Sep 10 00:19:02.078648 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.078463    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"
Sep 10 00:19:02.078648 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.078483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" event={"ID":"cae0a688-0af0-4eb1-89d1-677f0389ba99","Type":"ContainerDied","Data":"b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222"}
Sep 10 00:19:02.078648 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.078542    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h" event={"ID":"cae0a688-0af0-4eb1-89d1-677f0389ba99","Type":"ContainerDied","Data":"675eff68c650f8a0234e1eb3fcdc539536db7d3801791c71f6dfdea48f69a221"}
Sep 10 00:19:02.078648 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.078557    2560 scope.go:117] "RemoveContainer" containerID="b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222"
Sep 10 00:19:02.091304 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.091287    2560 scope.go:117] "RemoveContainer" containerID="3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38"
Sep 10 00:19:02.104910 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.104871    2560 scope.go:117] "RemoveContainer" containerID="b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222"
Sep 10 00:19:02.105292 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:19:02.105262    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222\": container with ID starting with b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222 not found: ID does not exist" containerID="b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222"
Sep 10 00:19:02.105402 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.105296    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222"} err="failed to get container status \"b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222\": rpc error: code = NotFound desc = could not find container \"b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222\": container with ID starting with b8e6625b91cc9b521daf3c66fa5a1bf3eaddd80606c5b3f2721d7813d0260222 not found: ID does not exist"
Sep 10 00:19:02.105402 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.105317    2560 scope.go:117] "RemoveContainer" containerID="3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38"
Sep 10 00:19:02.110948 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:19:02.106045    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38\": container with ID starting with 3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38 not found: ID does not exist" containerID="3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38"
Sep 10 00:19:02.111244 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.111204    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"]
Sep 10 00:19:02.111320 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.111256    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h"]
Sep 10 00:19:02.113376 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.113338    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38"} err="failed to get container status \"3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38\": rpc error: code = NotFound desc = could not find container \"3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38\": container with ID starting with 3dc8e985153bb27da8200dce64c41351e4f9691a006ea9773db1973224066b38 not found: ID does not exist"
Sep 10 00:19:02.341217 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:02.341136    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" path="/var/lib/kubelet/pods/cae0a688-0af0-4eb1-89d1-677f0389ba99/volumes"
Sep 10 00:19:15.355919 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:15.355878    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:15.454149 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:15.454104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:15.663656 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:15.663562    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:18.895831 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:18.895794    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:19:21.128253 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:21.128217    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:33.050205 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:33.050165    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:34.093839 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:34.093799    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:37.702160 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:37.702126    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:19:39.112169 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:39.112130    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"]
Sep 10 00:19:39.187288 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:39.187254    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:49.772989 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:49.772952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:49.848862 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:49.848800    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:49.909732 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:49.909694    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:50.010562 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:50.010522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:50.110577 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:50.110543    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:50.306867 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:50.306832    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:54.132292 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.132244    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t" podUID="1b6f978a-dffe-46f9-8f7c-f019af76254d" containerName="main" containerID="cri-o://eb37edf238f0b59f967cc44647dca7fa11ccd82b7b0a509a4cc9cd719415e778" gracePeriod=45
Sep 10 00:19:54.364749 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.364717    2560 generic.go:356] "Generic (PLEG): container finished" podID="1b6f978a-dffe-46f9-8f7c-f019af76254d" containerID="eb37edf238f0b59f967cc44647dca7fa11ccd82b7b0a509a4cc9cd719415e778" exitCode=0
Sep 10 00:19:54.364962 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.364793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t" event={"ID":"1b6f978a-dffe-46f9-8f7c-f019af76254d","Type":"ContainerDied","Data":"eb37edf238f0b59f967cc44647dca7fa11ccd82b7b0a509a4cc9cd719415e778"}
Sep 10 00:19:54.396770 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.396718    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:19:54.491494 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.491460    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b6f978a-dffe-46f9-8f7c-f019af76254d-tls-certs\") pod \"1b6f978a-dffe-46f9-8f7c-f019af76254d\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") "
Sep 10 00:19:54.491679 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.491521    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkbzx\" (UniqueName: \"kubernetes.io/projected/1b6f978a-dffe-46f9-8f7c-f019af76254d-kube-api-access-jkbzx\") pod \"1b6f978a-dffe-46f9-8f7c-f019af76254d\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") "
Sep 10 00:19:54.491679 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.491558    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-model-cache\") pod \"1b6f978a-dffe-46f9-8f7c-f019af76254d\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") "
Sep 10 00:19:54.491679 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.491656    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-home\") pod \"1b6f978a-dffe-46f9-8f7c-f019af76254d\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") "
Sep 10 00:19:54.491849 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.491694    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-dshm\") pod \"1b6f978a-dffe-46f9-8f7c-f019af76254d\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") "
Sep 10 00:19:54.491849 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.491721    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-tmp-dir\") pod \"1b6f978a-dffe-46f9-8f7c-f019af76254d\" (UID: \"1b6f978a-dffe-46f9-8f7c-f019af76254d\") "
Sep 10 00:19:54.492095 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.491995    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-home" (OuterVolumeSpecName: "home") pod "1b6f978a-dffe-46f9-8f7c-f019af76254d" (UID: "1b6f978a-dffe-46f9-8f7c-f019af76254d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:19:54.492334 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.492276    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-home\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:54.492428 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.492386    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b6f978a-dffe-46f9-8f7c-f019af76254d" (UID: "1b6f978a-dffe-46f9-8f7c-f019af76254d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:19:54.492490 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.492464    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b6f978a-dffe-46f9-8f7c-f019af76254d" (UID: "1b6f978a-dffe-46f9-8f7c-f019af76254d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:19:54.494868 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.494840    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b6f978a-dffe-46f9-8f7c-f019af76254d-kube-api-access-jkbzx" (OuterVolumeSpecName: "kube-api-access-jkbzx") pod "1b6f978a-dffe-46f9-8f7c-f019af76254d" (UID: "1b6f978a-dffe-46f9-8f7c-f019af76254d"). InnerVolumeSpecName "kube-api-access-jkbzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:19:54.495315 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.495273    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b6f978a-dffe-46f9-8f7c-f019af76254d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b6f978a-dffe-46f9-8f7c-f019af76254d" (UID: "1b6f978a-dffe-46f9-8f7c-f019af76254d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:19:54.495406 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.495353    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-dshm" (OuterVolumeSpecName: "dshm") pod "1b6f978a-dffe-46f9-8f7c-f019af76254d" (UID: "1b6f978a-dffe-46f9-8f7c-f019af76254d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:19:54.593461 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.593424    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-dshm\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:54.593461 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.593458    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-tmp-dir\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:54.593669 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.593474    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b6f978a-dffe-46f9-8f7c-f019af76254d-tls-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:54.593669 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.593484    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkbzx\" (UniqueName: \"kubernetes.io/projected/1b6f978a-dffe-46f9-8f7c-f019af76254d-kube-api-access-jkbzx\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:54.593669 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:54.593494    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b6f978a-dffe-46f9-8f7c-f019af76254d-model-cache\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:19:55.371948 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:55.371909    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"
Sep 10 00:19:55.372353 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:55.371913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t" event={"ID":"1b6f978a-dffe-46f9-8f7c-f019af76254d","Type":"ContainerDied","Data":"afcc86f3d9d1bf83fdf70914b7d8361a4f845bcbdc4679b2f372ef36deadf11f"}
Sep 10 00:19:55.372353 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:55.372054    2560 scope.go:117] "RemoveContainer" containerID="eb37edf238f0b59f967cc44647dca7fa11ccd82b7b0a509a4cc9cd719415e778"
Sep 10 00:19:55.395477 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:55.395451    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"]
Sep 10 00:19:55.406457 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:55.406432    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-cc0040/premium-w4-cc0040-kserve-68b7d577d6-rtw9t"]
Sep 10 00:19:56.094985 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:56.094922    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:56.151523 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:56.151490    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:56.342515 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:56.342476    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b6f978a-dffe-46f9-8f7c-f019af76254d" path="/var/lib/kubelet/pods/1b6f978a-dffe-46f9-8f7c-f019af76254d/volumes"
Sep 10 00:19:56.352361 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:56.352288    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"]
Sep 10 00:19:56.352550 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:56.352521    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy" containerID="cri-o://77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e" gracePeriod=30
Sep 10 00:19:56.366507 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:56.366479    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:19:58.005492 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:19:58.005458    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:20:01.607391 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.607363    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:20:01.767211 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767125    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ae2bcf-a251-4378-82c5-ac36019974be-istiod-ca-cert\") pod \"90ae2bcf-a251-4378-82c5-ac36019974be\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") "
Sep 10 00:20:01.767211 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-data\") pod \"90ae2bcf-a251-4378-82c5-ac36019974be\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") "
Sep 10 00:20:01.767211 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767185    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-istio-token\") pod \"90ae2bcf-a251-4378-82c5-ac36019974be\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") "
Sep 10 00:20:01.767211 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767203    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-credential-socket\") pod \"90ae2bcf-a251-4378-82c5-ac36019974be\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") "
Sep 10 00:20:01.767489 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767230    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ae2bcf-a251-4378-82c5-ac36019974be-istio-podinfo\") pod \"90ae2bcf-a251-4378-82c5-ac36019974be\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") "
Sep 10 00:20:01.767489 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767254    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-socket\") pod \"90ae2bcf-a251-4378-82c5-ac36019974be\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") "
Sep 10 00:20:01.767489 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767286    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-certs\") pod \"90ae2bcf-a251-4378-82c5-ac36019974be\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") "
Sep 10 00:20:01.767489 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767312    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfw5m\" (UniqueName: \"kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-kube-api-access-xfw5m\") pod \"90ae2bcf-a251-4378-82c5-ac36019974be\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") "
Sep 10 00:20:01.767489 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767343    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-envoy\") pod \"90ae2bcf-a251-4378-82c5-ac36019974be\" (UID: \"90ae2bcf-a251-4378-82c5-ac36019974be\") "
Sep 10 00:20:01.767489 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767459    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90ae2bcf-a251-4378-82c5-ac36019974be" (UID: "90ae2bcf-a251-4378-82c5-ac36019974be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:20:01.767773 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767601    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90ae2bcf-a251-4378-82c5-ac36019974be" (UID: "90ae2bcf-a251-4378-82c5-ac36019974be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:20:01.767773 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767469    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-data" (OuterVolumeSpecName: "istio-data") pod "90ae2bcf-a251-4378-82c5-ac36019974be" (UID: "90ae2bcf-a251-4378-82c5-ac36019974be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:20:01.767773 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767601    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90ae2bcf-a251-4378-82c5-ac36019974be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90ae2bcf-a251-4378-82c5-ac36019974be" (UID: "90ae2bcf-a251-4378-82c5-ac36019974be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:20:01.767973 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767784    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:20:01.767973 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767804    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:20:01.767973 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767812    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90ae2bcf-a251-4378-82c5-ac36019974be" (UID: "90ae2bcf-a251-4378-82c5-ac36019974be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:20:01.767973 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767820    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ae2bcf-a251-4378-82c5-ac36019974be-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:20:01.767973 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.767864    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:20:01.769581 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.769548    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-kube-api-access-xfw5m" (OuterVolumeSpecName: "kube-api-access-xfw5m") pod "90ae2bcf-a251-4378-82c5-ac36019974be" (UID: "90ae2bcf-a251-4378-82c5-ac36019974be"). InnerVolumeSpecName "kube-api-access-xfw5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:20:01.769705 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.769631    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-istio-token" (OuterVolumeSpecName: "istio-token") pod "90ae2bcf-a251-4378-82c5-ac36019974be" (UID: "90ae2bcf-a251-4378-82c5-ac36019974be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:20:01.769926 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.769903    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90ae2bcf-a251-4378-82c5-ac36019974be" (UID: "90ae2bcf-a251-4378-82c5-ac36019974be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:20:01.769926 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.769905    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90ae2bcf-a251-4378-82c5-ac36019974be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90ae2bcf-a251-4378-82c5-ac36019974be" (UID: "90ae2bcf-a251-4378-82c5-ac36019974be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:20:01.868787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.868753    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ae2bcf-a251-4378-82c5-ac36019974be-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:20:01.868787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.868779    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:20:01.868787 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.868789    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfw5m\" (UniqueName: \"kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-kube-api-access-xfw5m\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:20:01.869050 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.868798    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ae2bcf-a251-4378-82c5-ac36019974be-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:20:01.869050 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:01.868806    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ae2bcf-a251-4378-82c5-ac36019974be-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:20:02.412901 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.412864    2560 generic.go:356] "Generic (PLEG): container finished" podID="90ae2bcf-a251-4378-82c5-ac36019974be" containerID="77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e" exitCode=0
Sep 10 00:20:02.413083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.412924    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"
Sep 10 00:20:02.413083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.412968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" event={"ID":"90ae2bcf-a251-4378-82c5-ac36019974be","Type":"ContainerDied","Data":"77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e"}
Sep 10 00:20:02.413083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.413046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl" event={"ID":"90ae2bcf-a251-4378-82c5-ac36019974be","Type":"ContainerDied","Data":"500f0e26fba31bfe720f3cdab0d615e69047abf6eaf0bbf475f02baa0651e52c"}
Sep 10 00:20:02.413083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.413067    2560 scope.go:117] "RemoveContainer" containerID="77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e"
Sep 10 00:20:02.421770 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.421756    2560 scope.go:117] "RemoveContainer" containerID="56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3"
Sep 10 00:20:02.432536 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.431183    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"]
Sep 10 00:20:02.432879 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.432853    2560 scope.go:117] "RemoveContainer" containerID="77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e"
Sep 10 00:20:02.433247 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:20:02.433225    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e\": container with ID starting with 77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e not found: ID does not exist" containerID="77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e"
Sep 10 00:20:02.433319 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.433253    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e"} err="failed to get container status \"77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e\": rpc error: code = NotFound desc = could not find container \"77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e\": container with ID starting with 77bd77cb10af3f2820802de04efa81e95b9ea5a278344d6bdf7df3cf31a5e97e not found: ID does not exist"
Sep 10 00:20:02.433319 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.433274    2560 scope.go:117] "RemoveContainer" containerID="56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3"
Sep 10 00:20:02.433571 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:20:02.433548    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3\": container with ID starting with 56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3 not found: ID does not exist" containerID="56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3"
Sep 10 00:20:02.433643 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.433579    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3"} err="failed to get container status \"56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3\": rpc error: code = NotFound desc = could not find container \"56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3\": container with ID starting with 56e2d3094667e73bad24b2cfd2fa6200d0c32ec1320c75ac28cd3fc6bab011c3 not found: ID does not exist"
Sep 10 00:20:02.434133 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:02.434117    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl"]
Sep 10 00:20:04.339895 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:04.339864    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" path="/var/lib/kubelet/pods/90ae2bcf-a251-4378-82c5-ac36019974be/volumes"
Sep 10 00:20:05.795141 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:05.795107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:20:07.460894 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:07.460860    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:20:09.097924 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:09.097828    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:20:15.284471 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:15.284435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:20:15.382571 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:15.382532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:20:15.649608 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:15.649575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:20:15.739563 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:15.739530    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:20:16.730955 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:16.730899    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:20:18.004944 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:18.004908    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:20:22.136316 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:22.136280    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:20:33.883829 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:33.883791    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:20:37.398111 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:37.398073    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:20:54.999437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:20:54.999398    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:21:07.901688 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:21:07.901648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:21:15.211746 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:21:15.211706    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:21:25.054189 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:21:25.054153    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:21:25.860431 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:21:25.860400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:21:27.902270 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:21:27.902229    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:21:37.974548 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:21:37.974513    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:21:40.906712 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:21:40.906626    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:21:44.021603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:21:44.021564    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:21:47.535592 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:21:47.535555    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:03.067442 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:03.067412    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:06.703526 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:06.703489    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:22:07.708990 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:07.708918    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:29.098817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:29.098782    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:22:39.594802 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:39.594759    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:22:44.645920 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:44.645882    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:45.556432 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:45.556390    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:45.976589 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:45.976504    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:46.252199 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252114    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"]
Sep 10 00:22:46.252712 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252686    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252714    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252730    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252739    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252750    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6f978a-dffe-46f9-8f7c-f019af76254d" containerName="main"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252758    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6f978a-dffe-46f9-8f7c-f019af76254d" containerName="main"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252773    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252781    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252791    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252800    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252812    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy"
Sep 10 00:22:46.252817 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252820    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252838    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252846    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252857    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b1906d6-5143-4fd2-866c-267ffe7a59bd" containerName="maas-api"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252866    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1906d6-5143-4fd2-866c-267ffe7a59bd" containerName="maas-api"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252874    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252883    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252894    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a7412c-a6a2-4594-a68b-077b70b62b66" containerName="main"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252902    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a7412c-a6a2-4594-a68b-077b70b62b66" containerName="main"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252911    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252919    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252947    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9c5fd1-7ab0-412d-a18a-e41398e81e1d" containerName="maas-api"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252956    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9c5fd1-7ab0-412d-a18a-e41398e81e1d" containerName="maas-api"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252967    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252975    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252990    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.252998    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253010    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253018    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253038    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee41fbff-ad54-43d0-b8a6-64d15c596017" containerName="main"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253047    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee41fbff-ad54-43d0-b8a6-64d15c596017" containerName="main"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253132    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9c5fd1-7ab0-412d-a18a-e41398e81e1d" containerName="maas-api"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253143    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253154    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253163    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253171    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a26bf91-f389-4522-8d3d-173db5feb1fc" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253180    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253188    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253198    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253210    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253218    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee41fbff-ad54-43d0-b8a6-64d15c596017" containerName="main"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253227    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b6f978a-dffe-46f9-8f7c-f019af76254d" containerName="main"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253235    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b1906d6-5143-4fd2-866c-267ffe7a59bd" containerName="maas-api"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253243    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de27466-3553-4492-842c-21c42ce7fb99" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253253    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="90ae2bcf-a251-4378-82c5-ac36019974be" containerName="istio-proxy"
Sep 10 00:22:46.253504 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.253262    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="26a7412c-a6a2-4594-a68b-077b70b62b66" containerName="main"
Sep 10 00:22:46.256737 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.256718    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.259209 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.259186    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-918bbb-openshift-default-dockercfg-7pxrn\""
Sep 10 00:22:46.267988 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.267962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"]
Sep 10 00:22:46.272099 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.272067    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:46.385526 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.385487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-data\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.385526 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.385531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-envoy\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.385801 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.385600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-credential-socket\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.385801 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.385673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-socket\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.385801 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.385697    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41897496-473e-46e8-8a18-fcac29749541-istio-podinfo\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.385801 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.385741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41897496-473e-46e8-8a18-fcac29749541-istiod-ca-cert\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.385801 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.385799    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77t4m\" (UniqueName: \"kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-kube-api-access-77t4m\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.386103 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.385845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-istio-token\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.386103 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.385865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-certs\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487238 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-credential-socket\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487398 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-socket\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487398 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41897496-473e-46e8-8a18-fcac29749541-istio-podinfo\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487398 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41897496-473e-46e8-8a18-fcac29749541-istiod-ca-cert\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487398 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77t4m\" (UniqueName: \"kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-kube-api-access-77t4m\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487653 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-istio-token\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487653 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-certs\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487653 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487536    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-data\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487653 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-envoy\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487871 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-credential-socket\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487871 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-socket\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.487871 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-certs\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.488047 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.487977    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-data\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.488522 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.488500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41897496-473e-46e8-8a18-fcac29749541-istiod-ca-cert\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.490254 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.490232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-envoy\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.490409 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.490389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41897496-473e-46e8-8a18-fcac29749541-istio-podinfo\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.495562 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.495537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77t4m\" (UniqueName: \"kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-kube-api-access-77t4m\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.495915 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.495895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-istio-token\") pod \"e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") " pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.538978 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.538873    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:46.569083 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.569054    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:46.846535 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.846508    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"]
Sep 10 00:22:46.848633 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:22:46.848605    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41897496_473e_46e8_8a18_fcac29749541.slice/crio-7e8386519fb7cf0f026cdd3eece5ebb4e6a68a112596236848d158ceb436a78e WatchSource:0}: Error finding container 7e8386519fb7cf0f026cdd3eece5ebb4e6a68a112596236848d158ceb436a78e: Status 404 returned error can't find the container with id 7e8386519fb7cf0f026cdd3eece5ebb4e6a68a112596236848d158ceb436a78e
Sep 10 00:22:46.851308 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.851268    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:22:46.851426 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.851356    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:22:46.851426 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:46.851406    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:22:47.276442 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:47.276319    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" event={"ID":"41897496-473e-46e8-8a18-fcac29749541","Type":"ContainerStarted","Data":"a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e"}
Sep 10 00:22:47.276442 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:47.276375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" event={"ID":"41897496-473e-46e8-8a18-fcac29749541","Type":"ContainerStarted","Data":"7e8386519fb7cf0f026cdd3eece5ebb4e6a68a112596236848d158ceb436a78e"}
Sep 10 00:22:47.296395 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:47.296342    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" podStartSLOduration=1.296324545 podStartE2EDuration="1.296324545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:22:47.294477827 +0000 UTC m=+2041.426605056" watchObservedRunningTime="2026-09-10 00:22:47.296324545 +0000 UTC m=+2041.428451811"
Sep 10 00:22:47.569697 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:47.569666    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:47.574796 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:47.574771    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:48.282269 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:48.282237    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:48.283303 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:48.283284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:22:49.279438 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:49.279401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:49.342667 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:49.342633    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:50.332967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.332923    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"]
Sep 10 00:22:50.333448 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.333430    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy"
Sep 10 00:22:50.333448 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.333448    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae0a688-0af0-4eb1-89d1-677f0389ba99" containerName="istio-proxy"
Sep 10 00:22:50.333566 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.333509    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="753dc45a-aac1-4982-9050-2c245bf9d362" containerName="istio-proxy"
Sep 10 00:22:50.333566 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.333518    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="365e1102-10c5-403a-930a-649fb5bf24db" containerName="istio-proxy"
Sep 10 00:22:50.337168 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.337144    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.339357 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.339333    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-918bbb-serving-cert\""
Sep 10 00:22:50.351499 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.351474    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"]
Sep 10 00:22:50.365665 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.365639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:50.424629 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.424600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-metrics-certs\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.424768 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.424651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh9qx\" (UniqueName: \"kubernetes.io/projected/d1108ca8-fced-4f43-bfd9-a8fe102106ba-kube-api-access-jh9qx\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.424768 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.424690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1108ca8-fced-4f43-bfd9-a8fe102106ba-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.424768 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.424710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-maas-api-tls\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.470495 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.470461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:50.525872 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.525834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1108ca8-fced-4f43-bfd9-a8fe102106ba-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.526056 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.525877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-maas-api-tls\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.526056 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:22:50.526030    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-serving-cert: secret "maas-api-e2e-ipp-a-918bbb-serving-cert" not found
Sep 10 00:22:50.526136 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:22:50.526086    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-maas-api-tls podName:d1108ca8-fced-4f43-bfd9-a8fe102106ba nodeName:}" failed. No retries permitted until 2026-09-10 00:22:51.026071392 +0000 UTC m=+2045.158198614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-maas-api-tls") pod "maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9" (UID: "d1108ca8-fced-4f43-bfd9-a8fe102106ba") : secret "maas-api-e2e-ipp-a-918bbb-serving-cert" not found
Sep 10 00:22:50.526136 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.526033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-metrics-certs\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.526209 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.526173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh9qx\" (UniqueName: \"kubernetes.io/projected/d1108ca8-fced-4f43-bfd9-a8fe102106ba-kube-api-access-jh9qx\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.526630 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.526599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1108ca8-fced-4f43-bfd9-a8fe102106ba-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.528359 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.528339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-metrics-certs\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.534510 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.534485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh9qx\" (UniqueName: \"kubernetes.io/projected/d1108ca8-fced-4f43-bfd9-a8fe102106ba-kube-api-access-jh9qx\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:50.696888 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.696795    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:50.936839 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:50.936806    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:51.031255 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:51.031165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-maas-api-tls\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:51.033574 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:51.033552    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-maas-api-tls\") pod \"maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:51.040013 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:51.039987    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:22:51.250961 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:51.250916    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:51.524245 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:51.524222    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"]
Sep 10 00:22:51.526075 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:22:51.526046    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1108ca8_fced_4f43_bfd9_a8fe102106ba.slice/crio-dec965450f743521e408edb2bd6b34f1a75b0b4544f63e6af2c28e546b62bb0b WatchSource:0}: Error finding container dec965450f743521e408edb2bd6b34f1a75b0b4544f63e6af2c28e546b62bb0b: Status 404 returned error can't find the container with id dec965450f743521e408edb2bd6b34f1a75b0b4544f63e6af2c28e546b62bb0b
Sep 10 00:22:51.527535 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:51.527513    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 00:22:52.310467 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:52.310427    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9" event={"ID":"d1108ca8-fced-4f43-bfd9-a8fe102106ba","Type":"ContainerStarted","Data":"ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48"}
Sep 10 00:22:52.310652 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:52.310502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9" event={"ID":"d1108ca8-fced-4f43-bfd9-a8fe102106ba","Type":"ContainerStarted","Data":"dec965450f743521e408edb2bd6b34f1a75b0b4544f63e6af2c28e546b62bb0b"}
Sep 10 00:22:52.310652 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:52.310554    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:22:52.328320 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:52.328274    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9" podStartSLOduration=1.6409517839999999 podStartE2EDuration="2.328258403s" totalImagesPullingTime="687.306619ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:22:52.325413919 +0000 UTC m=+2046.457541194" watchObservedRunningTime="2026-09-10 00:22:52.328258403 +0000 UTC m=+2046.460385630"
Sep 10 00:22:52.601567 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:52.601527    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:22:58.321043 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:22:58.321011    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:23:03.284045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:03.283914    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 00:23:03.284045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:03.284005    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 00:23:03.372042 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:03.372009    2560 generic.go:356] "Generic (PLEG): container finished" podID="41897496-473e-46e8-8a18-fcac29749541" containerID="a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e" exitCode=0
Sep 10 00:23:03.372210 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:03.372089    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" event={"ID":"41897496-473e-46e8-8a18-fcac29749541","Type":"ContainerDied","Data":"a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e"}
Sep 10 00:23:03.372502 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:03.372489    2560 scope.go:117] "RemoveContainer" containerID="a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e"
Sep 10 00:23:03.373728 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:03.373694    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:23:03.373822 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:03.373783    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:23:03.373862 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:03.373832    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:23:04.379507 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:04.379469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" event={"ID":"41897496-473e-46e8-8a18-fcac29749541","Type":"ContainerStarted","Data":"1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724"}
Sep 10 00:23:04.569689 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:04.569642    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:23:04.569951 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:04.569899    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 00:23:04.570111 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:04.569990    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 00:23:05.569947 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:05.569901    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 00:23:05.570460 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:05.570000    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 00:23:06.570049 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:06.570006    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 00:23:06.570460 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:06.570084    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 00:23:07.570324 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:07.570279    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 00:23:07.570735 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:07.570344    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 00:23:08.570456 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:08.570418    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 00:23:08.570892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:08.570475    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 00:23:09.575332 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:09.575286    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:23:09.575777 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:09.575685    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:23:09.576398 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:09.576379    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:23:14.219829 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:14.219788    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:14.896265 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:14.896177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:15.173802 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.173702    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"]
Sep 10 00:23:15.176887 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.176866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.179421 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.179400    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-5c9018-openshift-default-dockercfg-7f9z5\""
Sep 10 00:23:15.186499 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.186475    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"]
Sep 10 00:23:15.200686 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.200665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:15.274129 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.274085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-envoy\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.274684 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.274655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpskj\" (UniqueName: \"kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-kube-api-access-tpskj\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.274808 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.274792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-podinfo\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.274917 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.274902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-token\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.275071 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.275052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istiod-ca-cert\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.275190 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.275177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-socket\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.275349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.275333    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-certs\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.275452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.275438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-data\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.275640 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.275625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-credential-socket\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376333 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-credential-socket\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376509 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-envoy\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376509 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpskj\" (UniqueName: \"kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-kube-api-access-tpskj\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376509 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-podinfo\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376509 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-token\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376725 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istiod-ca-cert\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376725 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-socket\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376725 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-credential-socket\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376884 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-certs\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376884 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376869    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-socket\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.376884 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.376869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-data\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.377160 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.377138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-data\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.385219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.377623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-certs\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.385219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.377818    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istiod-ca-cert\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.385526 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.385503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-envoy\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.385913 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.385705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-podinfo\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.388229 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.388199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpskj\" (UniqueName: \"kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-kube-api-access-tpskj\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.388456 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.388436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-token\") pod \"e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") " pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.488446 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.488371    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:15.632378 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.632347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:15.759121 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.759094    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"]
Sep 10 00:23:15.761202 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:23:15.761165    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad9e54b_a6dc_4317_8a2c_d1f2637a87e1.slice/crio-47575fbb04264b447171fa4bc49d278e566869b3abe1a7a70619642c73d4cd3f WatchSource:0}: Error finding container 47575fbb04264b447171fa4bc49d278e566869b3abe1a7a70619642c73d4cd3f: Status 404 returned error can't find the container with id 47575fbb04264b447171fa4bc49d278e566869b3abe1a7a70619642c73d4cd3f
Sep 10 00:23:15.763925 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.763887    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:23:15.764048 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.763982    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:23:15.764048 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:15.764013    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:23:16.446391 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:16.446352    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" event={"ID":"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1","Type":"ContainerStarted","Data":"3be6d5753d093eb700f1240204a0fbd28cf37f3f2f16e8cae6bdcbf41a7d7e9d"}
Sep 10 00:23:16.446849 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:16.446416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" event={"ID":"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1","Type":"ContainerStarted","Data":"47575fbb04264b447171fa4bc49d278e566869b3abe1a7a70619642c73d4cd3f"}
Sep 10 00:23:16.466584 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:16.466540    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" podStartSLOduration=1.466525217 podStartE2EDuration="1.466525217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:23:16.463542549 +0000 UTC m=+2070.595669780" watchObservedRunningTime="2026-09-10 00:23:16.466525217 +0000 UTC m=+2070.598652500"
Sep 10 00:23:16.488575 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:16.488538    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:16.494207 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:16.494184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:17.452317 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:17.452284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:17.453452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:17.453431    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:18.333954 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:18.333892    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:18.434699 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:18.434667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:19.644084 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:19.644043    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:19.744751 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:19.744717    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:19.845498 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:19.845466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:20.076421 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:20.076390    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:20.171281 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:20.171248    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:25.495808 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:25.495772    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:23:33.494099 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:33.494058    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 00:23:33.494543 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:33.494138    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 00:23:35.554432 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:35.554398    2560 generic.go:356] "Generic (PLEG): container finished" podID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerID="3be6d5753d093eb700f1240204a0fbd28cf37f3f2f16e8cae6bdcbf41a7d7e9d" exitCode=0
Sep 10 00:23:35.554990 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:35.554473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" event={"ID":"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1","Type":"ContainerDied","Data":"3be6d5753d093eb700f1240204a0fbd28cf37f3f2f16e8cae6bdcbf41a7d7e9d"}
Sep 10 00:23:35.554990 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:35.554891    2560 scope.go:117] "RemoveContainer" containerID="3be6d5753d093eb700f1240204a0fbd28cf37f3f2f16e8cae6bdcbf41a7d7e9d"
Sep 10 00:23:35.556058 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:35.556032    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:23:35.556151 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:35.556105    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:23:35.556151 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:35.556135    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:23:36.565718 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:36.565670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" event={"ID":"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1","Type":"ContainerStarted","Data":"5834ccd5ee7ac6aeb9f4361c362a975c31b229346a09f3143877127aec33b345"}
Sep 10 00:23:37.489459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:37.489426    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:37.489633 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:37.489589    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 00:23:37.489675 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:37.489642    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 00:23:37.504761 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:37.504727    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:38.489319 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:38.489282    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 00:23:38.489745 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:38.489345    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 00:23:39.489335 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:39.489298    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 00:23:39.489719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:39.489368    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 00:23:40.489058 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:40.489018    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 00:23:40.489237 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:40.489090    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 00:23:41.489706 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:41.489667    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 00:23:41.490130 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:41.489723    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 00:23:42.494078 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:42.494032    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:42.494490 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:42.494426    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:42.495000 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:42.494981    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:23:43.383088 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:43.383051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:23:46.476126 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:46.476087    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:23:46.478073 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:23:46.478051    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:24:02.284001 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:02.283960    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:06.295763 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:06.295728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:24:19.501808 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:19.501772    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:24:25.088564 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.088526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:25.360812 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.360725    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"]
Sep 10 00:24:25.364864 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.364843    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.367252 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.367232    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-70937b-openshift-default-dockercfg-vpklt\""
Sep 10 00:24:25.372998 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.372436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"]
Sep 10 00:24:25.384418 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.384392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:25.466856 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.466826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-data\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.466856 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.466858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-istio-token\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.467045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.466970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-credential-socket\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.467045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.467012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3706079-08db-448e-afb0-2f6d9cf67085-istiod-ca-cert\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.467124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.467048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-envoy\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.467124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.467082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-certs\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.467218 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.467130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-socket\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.467218 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.467159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdjct\" (UniqueName: \"kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-kube-api-access-rdjct\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.467290 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.467232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3706079-08db-448e-afb0-2f6d9cf67085-istio-podinfo\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.482291 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.482259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:25.568169 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-data\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568169 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-istio-token\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568432 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-credential-socket\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568432 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3706079-08db-448e-afb0-2f6d9cf67085-istiod-ca-cert\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568432 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-envoy\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568432 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-certs\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568644 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-socket\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568644 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdjct\" (UniqueName: \"kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-kube-api-access-rdjct\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568644 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3706079-08db-448e-afb0-2f6d9cf67085-istio-podinfo\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568644 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568592    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-data\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568806 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-certs\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.568981 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.568908    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-credential-socket\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.569097 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.569075    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-socket\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.569315 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.569295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3706079-08db-448e-afb0-2f6d9cf67085-istiod-ca-cert\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.570478 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.570458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-envoy\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.570942 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.570913    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3706079-08db-448e-afb0-2f6d9cf67085-istio-podinfo\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.576592 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.576564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-istio-token\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.576697 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.576675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdjct\" (UniqueName: \"kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-kube-api-access-rdjct\") pod \"e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") " pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.677084 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.676999    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:25.955697 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.955664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"]
Sep 10 00:24:25.957146 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:24:25.957117    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3706079_08db_448e_afb0_2f6d9cf67085.slice/crio-060e0da7f51dc85a6e0854c0344b15fe35957a7d8263688f158e678b6f66ed8b WatchSource:0}: Error finding container 060e0da7f51dc85a6e0854c0344b15fe35957a7d8263688f158e678b6f66ed8b: Status 404 returned error can't find the container with id 060e0da7f51dc85a6e0854c0344b15fe35957a7d8263688f158e678b6f66ed8b
Sep 10 00:24:25.959707 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.959669    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:24:25.959798 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.959757    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:24:25.959840 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:25.959812    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:24:26.831678 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:26.831637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" event={"ID":"e3706079-08db-448e-afb0-2f6d9cf67085","Type":"ContainerStarted","Data":"51347e4c77ecfd81934f5e43166e7a514d9fef0d9570637f51f793bba541fc8d"}
Sep 10 00:24:26.832118 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:26.831693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" event={"ID":"e3706079-08db-448e-afb0-2f6d9cf67085","Type":"ContainerStarted","Data":"060e0da7f51dc85a6e0854c0344b15fe35957a7d8263688f158e678b6f66ed8b"}
Sep 10 00:24:26.852591 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:26.852540    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" podStartSLOduration=1.852524515 podStartE2EDuration="1.852524515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:24:26.849331974 +0000 UTC m=+2140.981459202" watchObservedRunningTime="2026-09-10 00:24:26.852524515 +0000 UTC m=+2140.984651742"
Sep 10 00:24:27.677431 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:27.677396    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:27.682238 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:27.682213    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:27.837029 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:27.836996    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:27.837892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:27.837870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:28.844334 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:28.844299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:28.943332 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:28.943297    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:29.995829 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:29.995798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:30.052708 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:30.052671    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:30.549651 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:30.549591    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:30.646314 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:30.646279    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:30.752002 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:30.751762    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:33.415838 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:33.415806    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:33.518165 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:33.518134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:38.000728 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:38.000692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:24:48.959569 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:48.959530    2560 generic.go:356] "Generic (PLEG): container finished" podID="e3706079-08db-448e-afb0-2f6d9cf67085" containerID="51347e4c77ecfd81934f5e43166e7a514d9fef0d9570637f51f793bba541fc8d" exitCode=0
Sep 10 00:24:48.960030 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:48.959601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" event={"ID":"e3706079-08db-448e-afb0-2f6d9cf67085","Type":"ContainerDied","Data":"51347e4c77ecfd81934f5e43166e7a514d9fef0d9570637f51f793bba541fc8d"}
Sep 10 00:24:48.960030 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:48.959994    2560 scope.go:117] "RemoveContainer" containerID="51347e4c77ecfd81934f5e43166e7a514d9fef0d9570637f51f793bba541fc8d"
Sep 10 00:24:48.961214 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:48.961185    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:24:48.961303 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:48.961256    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:24:48.961303 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:48.961286    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 00:24:49.967335 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:49.967298    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" event={"ID":"e3706079-08db-448e-afb0-2f6d9cf67085","Type":"ContainerStarted","Data":"ffea81462d8abd3b02f71e5e0e88abb144442e88b804645a5b1f0c8ed984d486"}
Sep 10 00:24:50.677632 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:50.677590    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:50.677875 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:50.677848    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 10 00:24:50.677971 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:50.677908    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 10 00:24:51.678013 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:51.677969    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 10 00:24:51.678420 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:51.678029    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 10 00:24:52.677403 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:52.677357    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 10 00:24:52.677583 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:52.677445    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 10 00:24:53.678251 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:53.678210    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 10 00:24:53.678621 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:53.678278    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 10 00:24:53.736906 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:53.736873    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:24:54.678183 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:54.678147    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 10 00:24:54.678352 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:54.678212    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 10 00:24:55.677918 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:55.677881    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 10 00:24:55.678126 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:55.677975    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 10 00:24:56.681871 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:56.681840    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:56.682266 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:56.682147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:24:56.682955 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:24:56.682923    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:25:00.507978 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:00.507612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:00.607417 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:00.607388    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:00.681780 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:00.681732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:00.733661 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:00.733626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:01.028572 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:01.028527    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:05.096432 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:05.096394    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:25:06.635800 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:06.635757    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:06.737211 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:06.737080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:06.861195 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:06.861149    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"]
Sep 10 00:25:06.861438 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:06.861408    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy" containerID="cri-o://ffea81462d8abd3b02f71e5e0e88abb144442e88b804645a5b1f0c8ed984d486" gracePeriod=30
Sep 10 00:25:06.879734 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:06.879696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:10.619429 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:10.619391    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:11.684307 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:11.684270    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 00:25:11.684692 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:11.684325    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 00:25:12.093197 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.093163    2560 generic.go:356] "Generic (PLEG): container finished" podID="e3706079-08db-448e-afb0-2f6d9cf67085" containerID="ffea81462d8abd3b02f71e5e0e88abb144442e88b804645a5b1f0c8ed984d486" exitCode=0
Sep 10 00:25:12.093358 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.093236    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" event={"ID":"e3706079-08db-448e-afb0-2f6d9cf67085","Type":"ContainerDied","Data":"ffea81462d8abd3b02f71e5e0e88abb144442e88b804645a5b1f0c8ed984d486"}
Sep 10 00:25:12.093358 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.093300    2560 scope.go:117] "RemoveContainer" containerID="51347e4c77ecfd81934f5e43166e7a514d9fef0d9570637f51f793bba541fc8d"
Sep 10 00:25:12.127749 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.127723    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:25:12.234100 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234019    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-socket\") pod \"e3706079-08db-448e-afb0-2f6d9cf67085\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") "
Sep 10 00:25:12.234100 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234069    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-data\") pod \"e3706079-08db-448e-afb0-2f6d9cf67085\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") "
Sep 10 00:25:12.234100 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234104    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3706079-08db-448e-afb0-2f6d9cf67085-istio-podinfo\") pod \"e3706079-08db-448e-afb0-2f6d9cf67085\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") "
Sep 10 00:25:12.234328 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234137    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3706079-08db-448e-afb0-2f6d9cf67085-istiod-ca-cert\") pod \"e3706079-08db-448e-afb0-2f6d9cf67085\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") "
Sep 10 00:25:12.234328 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234176    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdjct\" (UniqueName: \"kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-kube-api-access-rdjct\") pod \"e3706079-08db-448e-afb0-2f6d9cf67085\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") "
Sep 10 00:25:12.234328 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234247    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-certs\") pod \"e3706079-08db-448e-afb0-2f6d9cf67085\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") "
Sep 10 00:25:12.234328 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234278    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-istio-token\") pod \"e3706079-08db-448e-afb0-2f6d9cf67085\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") "
Sep 10 00:25:12.234544 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234316    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e3706079-08db-448e-afb0-2f6d9cf67085" (UID: "e3706079-08db-448e-afb0-2f6d9cf67085"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:25:12.234544 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234366    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-data" (OuterVolumeSpecName: "istio-data") pod "e3706079-08db-448e-afb0-2f6d9cf67085" (UID: "e3706079-08db-448e-afb0-2f6d9cf67085"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:25:12.234544 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234374    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-credential-socket\") pod \"e3706079-08db-448e-afb0-2f6d9cf67085\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") "
Sep 10 00:25:12.234544 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234398    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-envoy\") pod \"e3706079-08db-448e-afb0-2f6d9cf67085\" (UID: \"e3706079-08db-448e-afb0-2f6d9cf67085\") "
Sep 10 00:25:12.234752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234544    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e3706079-08db-448e-afb0-2f6d9cf67085" (UID: "e3706079-08db-448e-afb0-2f6d9cf67085"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:25:12.234752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234564    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3706079-08db-448e-afb0-2f6d9cf67085-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e3706079-08db-448e-afb0-2f6d9cf67085" (UID: "e3706079-08db-448e-afb0-2f6d9cf67085"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:25:12.234752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234637    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e3706079-08db-448e-afb0-2f6d9cf67085" (UID: "e3706079-08db-448e-afb0-2f6d9cf67085"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:25:12.234874 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234782    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3706079-08db-448e-afb0-2f6d9cf67085-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:12.234874 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234803    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:12.234874 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234816    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:12.234874 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234831    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:12.234874 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.234844    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:12.236410 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.236377    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e3706079-08db-448e-afb0-2f6d9cf67085-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e3706079-08db-448e-afb0-2f6d9cf67085" (UID: "e3706079-08db-448e-afb0-2f6d9cf67085"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:25:12.236515 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.236411    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-kube-api-access-rdjct" (OuterVolumeSpecName: "kube-api-access-rdjct") pod "e3706079-08db-448e-afb0-2f6d9cf67085" (UID: "e3706079-08db-448e-afb0-2f6d9cf67085"). InnerVolumeSpecName "kube-api-access-rdjct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:25:12.236681 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.236663    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e3706079-08db-448e-afb0-2f6d9cf67085" (UID: "e3706079-08db-448e-afb0-2f6d9cf67085"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:25:12.236681 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.236669    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-istio-token" (OuterVolumeSpecName: "istio-token") pod "e3706079-08db-448e-afb0-2f6d9cf67085" (UID: "e3706079-08db-448e-afb0-2f6d9cf67085"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:25:12.335711 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.335682    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3706079-08db-448e-afb0-2f6d9cf67085-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:12.335711 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.335712    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3706079-08db-448e-afb0-2f6d9cf67085-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:12.335863 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.335726    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdjct\" (UniqueName: \"kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-kube-api-access-rdjct\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:12.335863 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:12.335740    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3706079-08db-448e-afb0-2f6d9cf67085-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:13.099340 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:13.099305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk" event={"ID":"e3706079-08db-448e-afb0-2f6d9cf67085","Type":"ContainerDied","Data":"060e0da7f51dc85a6e0854c0344b15fe35957a7d8263688f158e678b6f66ed8b"}
Sep 10 00:25:13.099782 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:13.099361    2560 scope.go:117] "RemoveContainer" containerID="ffea81462d8abd3b02f71e5e0e88abb144442e88b804645a5b1f0c8ed984d486"
Sep 10 00:25:13.099782 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:13.099323    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"
Sep 10 00:25:13.116674 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:13.116649    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"]
Sep 10 00:25:13.123124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:13.123103    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk"]
Sep 10 00:25:14.340559 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:14.340521    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" path="/var/lib/kubelet/pods/e3706079-08db-448e-afb0-2f6d9cf67085/volumes"
Sep 10 00:25:23.407003 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:23.406960    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:25:25.870339 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:25.870303    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"]
Sep 10 00:25:25.895858 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:25.895821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:25.992913 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:25.992879    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:26.062840 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.062810    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:26.116756 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.116721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:26.173278 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.173168    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9" podUID="d1108ca8-fced-4f43-bfd9-a8fe102106ba" containerName="maas-api" containerID="cri-o://ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48" gracePeriod=30
Sep 10 00:25:26.429556 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.429497    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:25:26.575633 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.575596    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh9qx\" (UniqueName: \"kubernetes.io/projected/d1108ca8-fced-4f43-bfd9-a8fe102106ba-kube-api-access-jh9qx\") pod \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") "
Sep 10 00:25:26.575799 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.575683    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1108ca8-fced-4f43-bfd9-a8fe102106ba-openshift-service-ca\") pod \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") "
Sep 10 00:25:26.575840 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.575798    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-maas-api-tls\") pod \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") "
Sep 10 00:25:26.575882 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.575844    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-metrics-certs\") pod \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\" (UID: \"d1108ca8-fced-4f43-bfd9-a8fe102106ba\") "
Sep 10 00:25:26.576130 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.576093    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1108ca8-fced-4f43-bfd9-a8fe102106ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1108ca8-fced-4f43-bfd9-a8fe102106ba" (UID: "d1108ca8-fced-4f43-bfd9-a8fe102106ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:25:26.576281 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.576229    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1108ca8-fced-4f43-bfd9-a8fe102106ba-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:26.577813 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.577787    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1108ca8-fced-4f43-bfd9-a8fe102106ba-kube-api-access-jh9qx" (OuterVolumeSpecName: "kube-api-access-jh9qx") pod "d1108ca8-fced-4f43-bfd9-a8fe102106ba" (UID: "d1108ca8-fced-4f43-bfd9-a8fe102106ba"). InnerVolumeSpecName "kube-api-access-jh9qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:25:26.577949 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.577811    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1108ca8-fced-4f43-bfd9-a8fe102106ba" (UID: "d1108ca8-fced-4f43-bfd9-a8fe102106ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:25:26.577949 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.577872    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d1108ca8-fced-4f43-bfd9-a8fe102106ba" (UID: "d1108ca8-fced-4f43-bfd9-a8fe102106ba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:25:26.649225 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.649190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:26.677600 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.677572    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:26.677600 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.677595    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1108ca8-fced-4f43-bfd9-a8fe102106ba-metrics-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:26.677773 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:26.677605    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh9qx\" (UniqueName: \"kubernetes.io/projected/d1108ca8-fced-4f43-bfd9-a8fe102106ba-kube-api-access-jh9qx\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:25:27.179458 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:27.179421    2560 generic.go:356] "Generic (PLEG): container finished" podID="d1108ca8-fced-4f43-bfd9-a8fe102106ba" containerID="ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48" exitCode=0
Sep 10 00:25:27.179956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:27.179469    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"
Sep 10 00:25:27.179956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:27.179510    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9" event={"ID":"d1108ca8-fced-4f43-bfd9-a8fe102106ba","Type":"ContainerDied","Data":"ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48"}
Sep 10 00:25:27.179956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:27.179579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9" event={"ID":"d1108ca8-fced-4f43-bfd9-a8fe102106ba","Type":"ContainerDied","Data":"dec965450f743521e408edb2bd6b34f1a75b0b4544f63e6af2c28e546b62bb0b"}
Sep 10 00:25:27.179956 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:27.179614    2560 scope.go:117] "RemoveContainer" containerID="ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48"
Sep 10 00:25:27.190975 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:27.190950    2560 scope.go:117] "RemoveContainer" containerID="ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48"
Sep 10 00:25:27.191228 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:25:27.191208    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48\": container with ID starting with ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48 not found: ID does not exist" containerID="ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48"
Sep 10 00:25:27.191278 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:27.191237    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48"} err="failed to get container status \"ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48\": rpc error: code = NotFound desc = could not find container \"ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48\": container with ID starting with ffcc316935cb6a389aa4a355b830e77be39315aef4353efa71848758a5e0bb48 not found: ID does not exist"
Sep 10 00:25:27.202904 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:27.202881    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"]
Sep 10 00:25:27.205637 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:27.205613    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-918bbb-65fbc686bf-d4mv9"]
Sep 10 00:25:28.340328 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:28.340294    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1108ca8-fced-4f43-bfd9-a8fe102106ba" path="/var/lib/kubelet/pods/d1108ca8-fced-4f43-bfd9-a8fe102106ba/volumes"
Sep 10 00:25:31.517535 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:31.517497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:25:36.702289 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:25:36.702256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:26:08.191531 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:08.191498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:08.301559 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:08.301512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:13.741510 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:13.741398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:15.836985 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:15.836925    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:19.531754 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:19.531717    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:19.589407 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:19.589345    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:19.799607 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:19.799574    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"]
Sep 10 00:26:19.799854 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:19.799822    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy" containerID="cri-o://1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724" gracePeriod=30
Sep 10 00:26:19.821449 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:19.821415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:20.414053 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:20.414017    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:24.578473 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:24.578439    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 00:26:24.578859 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:24.578497    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 00:26:25.056039 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.056002    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:26:25.131801 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.131758    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-credential-socket\") pod \"41897496-473e-46e8-8a18-fcac29749541\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") "
Sep 10 00:26:25.131801 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.131809    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-data\") pod \"41897496-473e-46e8-8a18-fcac29749541\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") "
Sep 10 00:26:25.132037 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.131826    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-certs\") pod \"41897496-473e-46e8-8a18-fcac29749541\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") "
Sep 10 00:26:25.132037 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.131863    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41897496-473e-46e8-8a18-fcac29749541-istio-podinfo\") pod \"41897496-473e-46e8-8a18-fcac29749541\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") "
Sep 10 00:26:25.132037 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.131881    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77t4m\" (UniqueName: \"kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-kube-api-access-77t4m\") pod \"41897496-473e-46e8-8a18-fcac29749541\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") "
Sep 10 00:26:25.132037 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.131905    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-socket\") pod \"41897496-473e-46e8-8a18-fcac29749541\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") "
Sep 10 00:26:25.132037 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.131955    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41897496-473e-46e8-8a18-fcac29749541-istiod-ca-cert\") pod \"41897496-473e-46e8-8a18-fcac29749541\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") "
Sep 10 00:26:25.132037 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.131991    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-istio-token\") pod \"41897496-473e-46e8-8a18-fcac29749541\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") "
Sep 10 00:26:25.132345 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.132065    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "41897496-473e-46e8-8a18-fcac29749541" (UID: "41897496-473e-46e8-8a18-fcac29749541"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:26:25.132345 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.132088    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-envoy\") pod \"41897496-473e-46e8-8a18-fcac29749541\" (UID: \"41897496-473e-46e8-8a18-fcac29749541\") "
Sep 10 00:26:25.132345 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.132092    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-data" (OuterVolumeSpecName: "istio-data") pod "41897496-473e-46e8-8a18-fcac29749541" (UID: "41897496-473e-46e8-8a18-fcac29749541"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:26:25.132345 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.132193    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "41897496-473e-46e8-8a18-fcac29749541" (UID: "41897496-473e-46e8-8a18-fcac29749541"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:26:25.132345 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.132329    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "41897496-473e-46e8-8a18-fcac29749541" (UID: "41897496-473e-46e8-8a18-fcac29749541"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:26:25.132603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.132525    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:25.132603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.132545    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:25.132603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.132559    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:25.132603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.132572    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:25.132603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.132568    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41897496-473e-46e8-8a18-fcac29749541-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "41897496-473e-46e8-8a18-fcac29749541" (UID: "41897496-473e-46e8-8a18-fcac29749541"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:26:25.134246 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.134217    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-istio-token" (OuterVolumeSpecName: "istio-token") pod "41897496-473e-46e8-8a18-fcac29749541" (UID: "41897496-473e-46e8-8a18-fcac29749541"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:26:25.134246 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.134217    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/41897496-473e-46e8-8a18-fcac29749541-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "41897496-473e-46e8-8a18-fcac29749541" (UID: "41897496-473e-46e8-8a18-fcac29749541"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:26:25.134401 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.134266    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-kube-api-access-77t4m" (OuterVolumeSpecName: "kube-api-access-77t4m") pod "41897496-473e-46e8-8a18-fcac29749541" (UID: "41897496-473e-46e8-8a18-fcac29749541"). InnerVolumeSpecName "kube-api-access-77t4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:26:25.134401 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.134387    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "41897496-473e-46e8-8a18-fcac29749541" (UID: "41897496-473e-46e8-8a18-fcac29749541"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:26:25.233268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.233213    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41897496-473e-46e8-8a18-fcac29749541-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:25.233268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.233235    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77t4m\" (UniqueName: \"kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-kube-api-access-77t4m\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:25.233268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.233246    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41897496-473e-46e8-8a18-fcac29749541-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:25.233268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.233255    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41897496-473e-46e8-8a18-fcac29749541-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:25.233268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.233263    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41897496-473e-46e8-8a18-fcac29749541-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:25.499068 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.498982    2560 generic.go:356] "Generic (PLEG): container finished" podID="41897496-473e-46e8-8a18-fcac29749541" containerID="1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724" exitCode=0
Sep 10 00:26:25.499068 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.499022    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"
Sep 10 00:26:25.499068 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.499031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" event={"ID":"41897496-473e-46e8-8a18-fcac29749541","Type":"ContainerDied","Data":"1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724"}
Sep 10 00:26:25.499320 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.499081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg" event={"ID":"41897496-473e-46e8-8a18-fcac29749541","Type":"ContainerDied","Data":"7e8386519fb7cf0f026cdd3eece5ebb4e6a68a112596236848d158ceb436a78e"}
Sep 10 00:26:25.499320 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.499105    2560 scope.go:117] "RemoveContainer" containerID="1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724"
Sep 10 00:26:25.508556 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.508538    2560 scope.go:117] "RemoveContainer" containerID="a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e"
Sep 10 00:26:25.516725 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.516708    2560 scope.go:117] "RemoveContainer" containerID="1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724"
Sep 10 00:26:25.517024 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:26:25.517006    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724\": container with ID starting with 1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724 not found: ID does not exist" containerID="1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724"
Sep 10 00:26:25.517124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.517036    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724"} err="failed to get container status \"1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724\": rpc error: code = NotFound desc = could not find container \"1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724\": container with ID starting with 1d6abaaf07f6898a0633afe6d42da91bc69df0f3619c3804d750244377abe724 not found: ID does not exist"
Sep 10 00:26:25.517124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.517061    2560 scope.go:117] "RemoveContainer" containerID="a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e"
Sep 10 00:26:25.517314 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:26:25.517298    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e\": container with ID starting with a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e not found: ID does not exist" containerID="a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e"
Sep 10 00:26:25.517355 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.517319    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e"} err="failed to get container status \"a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e\": rpc error: code = NotFound desc = could not find container \"a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e\": container with ID starting with a5362e76278741535aa7adfe5b08c4b17b39450a0fff3566a00d72e269a3121e not found: ID does not exist"
Sep 10 00:26:25.520619 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.520598    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"]
Sep 10 00:26:25.526366 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:25.526345    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg"]
Sep 10 00:26:26.339946 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:26.339905    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41897496-473e-46e8-8a18-fcac29749541" path="/var/lib/kubelet/pods/41897496-473e-46e8-8a18-fcac29749541/volumes"
Sep 10 00:26:30.607827 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:30.607794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:30.708653 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:30.708620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:30.783001 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:30.782952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:30.838425 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:30.838383    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:31.178224 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:31.178183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:33.601947 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:33.601906    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:26:37.028234 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:37.028194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:37.090078 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:37.090049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:37.343043 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:37.343011    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"]
Sep 10 00:26:37.343236 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:37.343213    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy" containerID="cri-o://5834ccd5ee7ac6aeb9f4361c362a975c31b229346a09f3143877127aec33b345" gracePeriod=30
Sep 10 00:26:37.364349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:37.364318    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:37.829480 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:37.829444    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:42.254174 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.254140    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:42.496598 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.496560    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 00:26:42.496752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.496618    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 00:26:42.591603 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.591574    2560 generic.go:356] "Generic (PLEG): container finished" podID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerID="5834ccd5ee7ac6aeb9f4361c362a975c31b229346a09f3143877127aec33b345" exitCode=0
Sep 10 00:26:42.591726 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.591657    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" event={"ID":"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1","Type":"ContainerDied","Data":"5834ccd5ee7ac6aeb9f4361c362a975c31b229346a09f3143877127aec33b345"}
Sep 10 00:26:42.591774 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.591728    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p" event={"ID":"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1","Type":"ContainerDied","Data":"47575fbb04264b447171fa4bc49d278e566869b3abe1a7a70619642c73d4cd3f"}
Sep 10 00:26:42.591774 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.591752    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47575fbb04264b447171fa4bc49d278e566869b3abe1a7a70619642c73d4cd3f"
Sep 10 00:26:42.591774 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.591770    2560 scope.go:117] "RemoveContainer" containerID="3be6d5753d093eb700f1240204a0fbd28cf37f3f2f16e8cae6bdcbf41a7d7e9d"
Sep 10 00:26:42.601058 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.601039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:26:42.702340 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702311    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-certs\") pod \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") "
Sep 10 00:26:42.702340 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702344    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-credential-socket\") pod \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") "
Sep 10 00:26:42.702578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702367    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-podinfo\") pod \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") "
Sep 10 00:26:42.702578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702418    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-envoy\") pod \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") "
Sep 10 00:26:42.702578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702436    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-data\") pod \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") "
Sep 10 00:26:42.702578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702456    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-token\") pod \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") "
Sep 10 00:26:42.702578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702476    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istiod-ca-cert\") pod \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") "
Sep 10 00:26:42.702578 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702547    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-socket\") pod \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") "
Sep 10 00:26:42.702907 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702629    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpskj\" (UniqueName: \"kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-kube-api-access-tpskj\") pod \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\" (UID: \"7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1\") "
Sep 10 00:26:42.702907 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702635    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" (UID: "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:26:42.702907 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702650    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" (UID: "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:26:42.702907 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702790    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" (UID: "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:26:42.702907 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702868    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" (UID: "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:26:42.703219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.702905    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" (UID: "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:26:42.703219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.703091    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:42.703219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.703110    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:42.703219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.703123    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:42.703219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.703137    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:42.703219 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.703151    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:42.704834 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.704806    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-kube-api-access-tpskj" (OuterVolumeSpecName: "kube-api-access-tpskj") pod "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" (UID: "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1"). InnerVolumeSpecName "kube-api-access-tpskj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:26:42.704986 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.704964    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" (UID: "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:26:42.705126 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.705108    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" (UID: "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:26:42.705126 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.705115    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" (UID: "7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:26:42.804316 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.804288    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpskj\" (UniqueName: \"kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-kube-api-access-tpskj\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:42.804316 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.804317    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:42.804490 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.804326    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:42.804490 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:42.804334    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:43.599481 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:43.599452    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"
Sep 10 00:26:43.631121 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:43.631093    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"]
Sep 10 00:26:43.636302 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:43.636268    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p"]
Sep 10 00:26:44.344192 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:44.344159    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" path="/var/lib/kubelet/pods/7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1/volumes"
Sep 10 00:26:44.829067 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:44.829039    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:47.823278 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:47.823246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:48.504066 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:48.504034    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:49.010000 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.009971    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"]
Sep 10 00:26:49.010467 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.010221    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9" podUID="c70ab0ff-7d56-4431-a4c5-fc8cce20b73a" containerName="maas-api" containerID="cri-o://e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3" gracePeriod=30
Sep 10 00:26:49.040426 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.040395    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:49.118710 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.118676    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:49.172514 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.172479    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:49.237428 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.237399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:49.264383 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.264332    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:26:49.365854 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.365812    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppjck\" (UniqueName: \"kubernetes.io/projected/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-kube-api-access-ppjck\") pod \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") "
Sep 10 00:26:49.366055 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.365914    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-metrics-certs\") pod \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") "
Sep 10 00:26:49.366055 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.365957    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-openshift-service-ca\") pod \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") "
Sep 10 00:26:49.366055 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.366019    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls\") pod \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\" (UID: \"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a\") "
Sep 10 00:26:49.366414 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.366385    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c70ab0ff-7d56-4431-a4c5-fc8cce20b73a" (UID: "c70ab0ff-7d56-4431-a4c5-fc8cce20b73a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:26:49.368042 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.368012    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-kube-api-access-ppjck" (OuterVolumeSpecName: "kube-api-access-ppjck") pod "c70ab0ff-7d56-4431-a4c5-fc8cce20b73a" (UID: "c70ab0ff-7d56-4431-a4c5-fc8cce20b73a"). InnerVolumeSpecName "kube-api-access-ppjck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:26:49.368042 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.368034    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c70ab0ff-7d56-4431-a4c5-fc8cce20b73a" (UID: "c70ab0ff-7d56-4431-a4c5-fc8cce20b73a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:26:49.368192 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.368021    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c70ab0ff-7d56-4431-a4c5-fc8cce20b73a" (UID: "c70ab0ff-7d56-4431-a4c5-fc8cce20b73a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:26:49.466836 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.466797    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppjck\" (UniqueName: \"kubernetes.io/projected/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-kube-api-access-ppjck\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:49.466836 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.466830    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-metrics-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:49.467054 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.466843    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:49.467054 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.466856    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:26:49.588189 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.588150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:49.634118 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.634087    2560 generic.go:356] "Generic (PLEG): container finished" podID="c70ab0ff-7d56-4431-a4c5-fc8cce20b73a" containerID="e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3" exitCode=0
Sep 10 00:26:49.634311 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.634129    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"
Sep 10 00:26:49.634311 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.634175    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9" event={"ID":"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a","Type":"ContainerDied","Data":"e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3"}
Sep 10 00:26:49.634311 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.634237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9" event={"ID":"c70ab0ff-7d56-4431-a4c5-fc8cce20b73a","Type":"ContainerDied","Data":"baf022b5a3e8469d5eb7df27721186fd26e15937631be391a6626dd771dc9959"}
Sep 10 00:26:49.634311 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.634266    2560 scope.go:117] "RemoveContainer" containerID="e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3"
Sep 10 00:26:49.644354 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.644334    2560 scope.go:117] "RemoveContainer" containerID="e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3"
Sep 10 00:26:49.644669 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:26:49.644643    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3\": container with ID starting with e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3 not found: ID does not exist" containerID="e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3"
Sep 10 00:26:49.644749 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.644679    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3"} err="failed to get container status \"e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3\": rpc error: code = NotFound desc = could not find container \"e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3\": container with ID starting with e8724a0f5205385b8e0d2d5074a6a0fbed1f756bd6464350804b6c3e03a205e3 not found: ID does not exist"
Sep 10 00:26:49.656155 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.656131    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"]
Sep 10 00:26:49.657881 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:49.657859    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1de9a7-655874f98f-6hxr9"]
Sep 10 00:26:50.340318 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:50.340271    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c70ab0ff-7d56-4431-a4c5-fc8cce20b73a" path="/var/lib/kubelet/pods/c70ab0ff-7d56-4431-a4c5-fc8cce20b73a/volumes"
Sep 10 00:26:51.912134 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:51.912098    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:26:55.549626 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:55.549597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:55.609174 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:55.609142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:55.795346 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:55.795310    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"]
Sep 10 00:26:55.795655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:55.795622    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy" containerID="cri-o://8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173" gracePeriod=30
Sep 10 00:26:55.822098 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:55.822006    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:56.326126 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:56.326094    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:26:57.635283 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:57.635249    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 00:26:57.635732 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:26:57.635320    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 00:27:01.049869 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.049844    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:27:01.171655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.171565    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-token\") pod \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") "
Sep 10 00:27:01.171655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.171613    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldm9l\" (UniqueName: \"kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-kube-api-access-ldm9l\") pod \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") "
Sep 10 00:27:01.171655 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.171643    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-data\") pod \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") "
Sep 10 00:27:01.171966 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.171683    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-podinfo\") pod \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") "
Sep 10 00:27:01.171966 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.171719    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-certs\") pod \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") "
Sep 10 00:27:01.171966 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.171755    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-socket\") pod \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") "
Sep 10 00:27:01.171966 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.171796    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istiod-ca-cert\") pod \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") "
Sep 10 00:27:01.171966 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.171822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-envoy\") pod \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") "
Sep 10 00:27:01.171966 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.171868    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-credential-socket\") pod \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\" (UID: \"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6\") "
Sep 10 00:27:01.172301 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.171994    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" (UID: "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:27:01.172301 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.172065    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" (UID: "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:27:01.172301 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.172098    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" (UID: "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:27:01.172301 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.172254    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" (UID: "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:27:01.172494 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.172343    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:01.172494 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.172364    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:01.172494 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.172366    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" (UID: "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:27:01.172494 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.172378    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:01.172494 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.172390    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:01.173869 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.173847    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" (UID: "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:27:01.174067 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.174044    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" (UID: "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:27:01.174257 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.174237    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" (UID: "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:27:01.174308 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.174252    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-kube-api-access-ldm9l" (OuterVolumeSpecName: "kube-api-access-ldm9l") pod "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" (UID: "8d8b3677-d98a-41fe-86b2-d0bbab81dbd6"). InnerVolumeSpecName "kube-api-access-ldm9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:27:01.273133 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.273106    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:01.273133 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.273131    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:01.273133 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.273140    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:01.273349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.273147    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:01.273349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.273156    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldm9l\" (UniqueName: \"kubernetes.io/projected/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6-kube-api-access-ldm9l\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:01.707768 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.707728    2560 generic.go:356] "Generic (PLEG): container finished" podID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerID="8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173" exitCode=0
Sep 10 00:27:01.707996 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.707777    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" event={"ID":"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6","Type":"ContainerDied","Data":"8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173"}
Sep 10 00:27:01.707996 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.707792    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"
Sep 10 00:27:01.707996 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.707819    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq" event={"ID":"8d8b3677-d98a-41fe-86b2-d0bbab81dbd6","Type":"ContainerDied","Data":"2e47b2c675235302a8bf7757a8b7e8e5c094e96a6ea061f95ea4bdfee5715e0f"}
Sep 10 00:27:01.707996 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.707846    2560 scope.go:117] "RemoveContainer" containerID="8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173"
Sep 10 00:27:01.717366 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.717345    2560 scope.go:117] "RemoveContainer" containerID="7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb"
Sep 10 00:27:01.724964 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.724924    2560 scope.go:117] "RemoveContainer" containerID="8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173"
Sep 10 00:27:01.725223 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:27:01.725202    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173\": container with ID starting with 8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173 not found: ID does not exist" containerID="8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173"
Sep 10 00:27:01.725271 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.725231    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173"} err="failed to get container status \"8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173\": rpc error: code = NotFound desc = could not find container \"8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173\": container with ID starting with 8c38af9d31b1f50c20dde068ccbb4860fbf50763f95b9bfae7dfbba697be3173 not found: ID does not exist"
Sep 10 00:27:01.725271 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.725249    2560 scope.go:117] "RemoveContainer" containerID="7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb"
Sep 10 00:27:01.725532 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:27:01.725513    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb\": container with ID starting with 7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb not found: ID does not exist" containerID="7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb"
Sep 10 00:27:01.725581 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.725539    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb"} err="failed to get container status \"7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb\": rpc error: code = NotFound desc = could not find container \"7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb\": container with ID starting with 7f97c62d443d63cbb9c4230e4c96a52f7cb782b11c5c39f95371cbc3e8ffcbeb not found: ID does not exist"
Sep 10 00:27:01.729495 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.729471    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"]
Sep 10 00:27:01.735580 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:01.735557    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq"]
Sep 10 00:27:02.340497 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:02.340462    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" path="/var/lib/kubelet/pods/8d8b3677-d98a-41fe-86b2-d0bbab81dbd6/volumes"
Sep 10 00:27:06.550319 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.550284    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"]
Sep 10 00:27:06.550856 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.550509    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4" podUID="e7cfe1cc-61aa-4b16-9f35-2c288e866ec6" containerName="maas-api" containerID="cri-o://7e910e1a734f694ba5859c83e4cfd4897d5c2cfaa96a16d8a225276399432016" gracePeriod=30
Sep 10 00:27:06.582800 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.582771    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:27:06.644962 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.644911    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:27:06.738941 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.738891    2560 generic.go:356] "Generic (PLEG): container finished" podID="e7cfe1cc-61aa-4b16-9f35-2c288e866ec6" containerID="7e910e1a734f694ba5859c83e4cfd4897d5c2cfaa96a16d8a225276399432016" exitCode=0
Sep 10 00:27:06.739087 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.738987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4" event={"ID":"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6","Type":"ContainerDied","Data":"7e910e1a734f694ba5859c83e4cfd4897d5c2cfaa96a16d8a225276399432016"}
Sep 10 00:27:06.745892 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.745864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:27:06.792014 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.791992    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:27:06.798639 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.798617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:27:06.820882 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.820818    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-metrics-certs\") pod \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") "
Sep 10 00:27:06.821031 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.820901    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-maas-api-tls\") pod \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") "
Sep 10 00:27:06.821031 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.821008    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-openshift-service-ca\") pod \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") "
Sep 10 00:27:06.821156 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.821046    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c522l\" (UniqueName: \"kubernetes.io/projected/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-kube-api-access-c522l\") pod \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\" (UID: \"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6\") "
Sep 10 00:27:06.821435 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.821407    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7cfe1cc-61aa-4b16-9f35-2c288e866ec6" (UID: "e7cfe1cc-61aa-4b16-9f35-2c288e866ec6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:27:06.822971 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.822925    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7cfe1cc-61aa-4b16-9f35-2c288e866ec6" (UID: "e7cfe1cc-61aa-4b16-9f35-2c288e866ec6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:27:06.823057 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.823019    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e7cfe1cc-61aa-4b16-9f35-2c288e866ec6" (UID: "e7cfe1cc-61aa-4b16-9f35-2c288e866ec6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:27:06.823057 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.823037    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-kube-api-access-c522l" (OuterVolumeSpecName: "kube-api-access-c522l") pod "e7cfe1cc-61aa-4b16-9f35-2c288e866ec6" (UID: "e7cfe1cc-61aa-4b16-9f35-2c288e866ec6"). InnerVolumeSpecName "kube-api-access-c522l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:27:06.923045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.922828    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:06.923045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.922861    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c522l\" (UniqueName: \"kubernetes.io/projected/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-kube-api-access-c522l\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:06.923045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.922878    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-metrics-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:06.923045 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:06.922893    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:07.157129 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:07.157021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:27:07.746076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:07.746048    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"
Sep 10 00:27:07.746076 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:07.746066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4" event={"ID":"e7cfe1cc-61aa-4b16-9f35-2c288e866ec6","Type":"ContainerDied","Data":"fbfa2db9144df1e94bb8bc6102f92f1ec1b38ec531a783e49109813256209c13"}
Sep 10 00:27:07.746586 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:07.746125    2560 scope.go:117] "RemoveContainer" containerID="7e910e1a734f694ba5859c83e4cfd4897d5c2cfaa96a16d8a225276399432016"
Sep 10 00:27:07.771510 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:07.771482    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"]
Sep 10 00:27:07.774783 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:07.774761    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b1baac-68f7987555-xnlv4"]
Sep 10 00:27:08.340288 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:08.340255    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7cfe1cc-61aa-4b16-9f35-2c288e866ec6" path="/var/lib/kubelet/pods/e7cfe1cc-61aa-4b16-9f35-2c288e866ec6/volumes"
Sep 10 00:27:09.093695 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:09.093661    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:27:13.194094 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:13.194055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:27:13.247632 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:13.247605    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:27:13.435855 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:13.435817    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"]
Sep 10 00:27:13.436095 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:13.436063    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy" containerID="cri-o://dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa" gracePeriod=30
Sep 10 00:27:13.465055 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:13.464971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:27:17.804824 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:17.804792    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:27:18.690475 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.690448    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:27:18.806282 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.806245    2560 generic.go:356] "Generic (PLEG): container finished" podID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerID="dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa" exitCode=0
Sep 10 00:27:18.806750 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.806291    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" event={"ID":"38df01a5-b33b-4fdc-b80c-b724b25ba18b","Type":"ContainerDied","Data":"dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa"}
Sep 10 00:27:18.806750 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.806360    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" event={"ID":"38df01a5-b33b-4fdc-b80c-b724b25ba18b","Type":"ContainerDied","Data":"f624a388893e6477c92e0349d97a260fc4b7f038c6e051910c5478ca6f6dd3d4"}
Sep 10 00:27:18.806750 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.806304    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"
Sep 10 00:27:18.806750 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.806396    2560 scope.go:117] "RemoveContainer" containerID="dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa"
Sep 10 00:27:18.815669 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.815652    2560 scope.go:117] "RemoveContainer" containerID="ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2"
Sep 10 00:27:18.823689 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.823671    2560 scope.go:117] "RemoveContainer" containerID="dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa"
Sep 10 00:27:18.824007 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:27:18.823980    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa\": container with ID starting with dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa not found: ID does not exist" containerID="dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa"
Sep 10 00:27:18.824089 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.824022    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa"} err="failed to get container status \"dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa\": rpc error: code = NotFound desc = could not find container \"dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa\": container with ID starting with dc6630383034c7d4f46c194b2b0d033bd5e001392b0f70060b911968cce160aa not found: ID does not exist"
Sep 10 00:27:18.824089 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.824047    2560 scope.go:117] "RemoveContainer" containerID="ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2"
Sep 10 00:27:18.824368 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:27:18.824350    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2\": container with ID starting with ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2 not found: ID does not exist" containerID="ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2"
Sep 10 00:27:18.824440 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.824376    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2"} err="failed to get container status \"ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2\": rpc error: code = NotFound desc = could not find container \"ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2\": container with ID starting with ed4ea0a89770f83b25b1d3716e9d8b2caf24b8b36d95d30a51f49c6697bce8c2 not found: ID does not exist"
Sep 10 00:27:18.832710 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.832689    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-data\") pod \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") "
Sep 10 00:27:18.832782 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.832718    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-socket\") pod \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") "
Sep 10 00:27:18.832782 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.832737    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istiod-ca-cert\") pod \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") "
Sep 10 00:27:18.832782 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.832753    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-envoy\") pod \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") "
Sep 10 00:27:18.832969 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.832787    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-credential-socket\") pod \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") "
Sep 10 00:27:18.832969 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.832847    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-token\") pod \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") "
Sep 10 00:27:18.832969 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.832876    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-certs\") pod \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") "
Sep 10 00:27:18.832969 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.832911    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-podinfo\") pod \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") "
Sep 10 00:27:18.832969 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.832949    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4c2w\" (UniqueName: \"kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-kube-api-access-f4c2w\") pod \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\" (UID: \"38df01a5-b33b-4fdc-b80c-b724b25ba18b\") "
Sep 10 00:27:18.833227 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.833038    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38df01a5-b33b-4fdc-b80c-b724b25ba18b" (UID: "38df01a5-b33b-4fdc-b80c-b724b25ba18b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:27:18.833283 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.833166    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38df01a5-b33b-4fdc-b80c-b724b25ba18b" (UID: "38df01a5-b33b-4fdc-b80c-b724b25ba18b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:27:18.833341 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.833283    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-data" (OuterVolumeSpecName: "istio-data") pod "38df01a5-b33b-4fdc-b80c-b724b25ba18b" (UID: "38df01a5-b33b-4fdc-b80c-b724b25ba18b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:27:18.833341 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.833289    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:18.833459 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.833436    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38df01a5-b33b-4fdc-b80c-b724b25ba18b" (UID: "38df01a5-b33b-4fdc-b80c-b724b25ba18b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:27:18.833552 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.833529    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38df01a5-b33b-4fdc-b80c-b724b25ba18b" (UID: "38df01a5-b33b-4fdc-b80c-b724b25ba18b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:27:18.835829 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.835798    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-token" (OuterVolumeSpecName: "istio-token") pod "38df01a5-b33b-4fdc-b80c-b724b25ba18b" (UID: "38df01a5-b33b-4fdc-b80c-b724b25ba18b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:27:18.835957 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.835891    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38df01a5-b33b-4fdc-b80c-b724b25ba18b" (UID: "38df01a5-b33b-4fdc-b80c-b724b25ba18b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:27:18.835957 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.835905    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38df01a5-b33b-4fdc-b80c-b724b25ba18b" (UID: "38df01a5-b33b-4fdc-b80c-b724b25ba18b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 00:27:18.835957 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.835914    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-kube-api-access-f4c2w" (OuterVolumeSpecName: "kube-api-access-f4c2w") pod "38df01a5-b33b-4fdc-b80c-b724b25ba18b" (UID: "38df01a5-b33b-4fdc-b80c-b724b25ba18b"). InnerVolumeSpecName "kube-api-access-f4c2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:27:18.934555 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.934510    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:18.934555 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.934544    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:18.934555 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.934556    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:18.934810 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.934569    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:18.934810 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.934582    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:18.934810 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.934592    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38df01a5-b33b-4fdc-b80c-b724b25ba18b-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:18.934810 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.934602    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38df01a5-b33b-4fdc-b80c-b724b25ba18b-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:18.934810 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:18.934615    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4c2w\" (UniqueName: \"kubernetes.io/projected/38df01a5-b33b-4fdc-b80c-b724b25ba18b-kube-api-access-f4c2w\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:27:19.129634 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:19.129602    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"]
Sep 10 00:27:19.132841 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:19.132812    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb"]
Sep 10 00:27:19.606632 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:19.606591    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 00:27:19.606828 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:19.606670    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 00:27:20.340070 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:20.340037    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" path="/var/lib/kubelet/pods/38df01a5-b33b-4fdc-b80c-b724b25ba18b/volumes"
Sep 10 00:27:52.583547 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:27:52.583512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:28:36.218909 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:28:36.218875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:28:36.319527 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:28:36.319491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:28:37.545820 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:28:37.545788    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:28:38.697178 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:28:38.697144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:28:38.897318 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:28:38.897282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:28:40.453981 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:28:40.453942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:28:46.507896 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:28:46.507869    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:28:46.510176 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:28:46.510155    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:29:02.496181 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:02.496100    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:29:10.201034 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:10.200941    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:29:18.799851 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:18.799817    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:29:36.306181 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:36.306141    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:29:42.301187 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:42.301145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:29:43.624986 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:43.624950    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"]
Sep 10 00:29:43.625378 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:43.625146    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerName="manager" containerID="cri-o://828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a" gracePeriod=10
Sep 10 00:29:45.376527 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.376502    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 10 00:29:45.517774 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.517696    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcn7c\" (UniqueName: \"kubernetes.io/projected/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-kube-api-access-xcn7c\") pod \"054a0ee3-3117-4578-b0e4-eb41fdcc14e6\" (UID: \"054a0ee3-3117-4578-b0e4-eb41fdcc14e6\") "
Sep 10 00:29:45.517912 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.517803    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-extensions-socket-volume\") pod \"054a0ee3-3117-4578-b0e4-eb41fdcc14e6\" (UID: \"054a0ee3-3117-4578-b0e4-eb41fdcc14e6\") "
Sep 10 00:29:45.518227 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.518195    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "054a0ee3-3117-4578-b0e4-eb41fdcc14e6" (UID: "054a0ee3-3117-4578-b0e4-eb41fdcc14e6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:29:45.519708 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.519685    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-kube-api-access-xcn7c" (OuterVolumeSpecName: "kube-api-access-xcn7c") pod "054a0ee3-3117-4578-b0e4-eb41fdcc14e6" (UID: "054a0ee3-3117-4578-b0e4-eb41fdcc14e6"). InnerVolumeSpecName "kube-api-access-xcn7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:29:45.537753 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.537724    2560 generic.go:356] "Generic (PLEG): container finished" podID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerID="828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a" exitCode=0
Sep 10 00:29:45.537841 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.537770    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"
Sep 10 00:29:45.537841 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.537811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" event={"ID":"054a0ee3-3117-4578-b0e4-eb41fdcc14e6","Type":"ContainerDied","Data":"828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a"}
Sep 10 00:29:45.537925 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.537861    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d" event={"ID":"054a0ee3-3117-4578-b0e4-eb41fdcc14e6","Type":"ContainerDied","Data":"ca601291f8798fd26ebcdb8e9925f88a1d45eb42cbbf59529d1630d426793544"}
Sep 10 00:29:45.537925 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.537887    2560 scope.go:117] "RemoveContainer" containerID="828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a"
Sep 10 00:29:45.546955 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.546928    2560 scope.go:117] "RemoveContainer" containerID="68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d"
Sep 10 00:29:45.554818 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.554803    2560 scope.go:117] "RemoveContainer" containerID="828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a"
Sep 10 00:29:45.555103 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:29:45.555086    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a\": container with ID starting with 828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a not found: ID does not exist" containerID="828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a"
Sep 10 00:29:45.555172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.555110    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a"} err="failed to get container status \"828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a\": rpc error: code = NotFound desc = could not find container \"828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a\": container with ID starting with 828fa6b700e9c728876eb2baeb34554c0ac4630756d897c9cd37f8d3675b325a not found: ID does not exist"
Sep 10 00:29:45.555172 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.555125    2560 scope.go:117] "RemoveContainer" containerID="68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d"
Sep 10 00:29:45.555355 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:29:45.555340    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d\": container with ID starting with 68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d not found: ID does not exist" containerID="68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d"
Sep 10 00:29:45.555396 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.555360    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d"} err="failed to get container status \"68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d\": rpc error: code = NotFound desc = could not find container \"68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d\": container with ID starting with 68e9fd54224ddfb7bfa85412fa7b5c1afe7b1e77fc43d6490f5ef3993d57080d not found: ID does not exist"
Sep 10 00:29:45.558921 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.558900    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"]
Sep 10 00:29:45.563797 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.563777    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2c72d"]
Sep 10 00:29:45.618835 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.618814    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-extensions-socket-volume\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:29:45.618835 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:45.618835    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcn7c\" (UniqueName: \"kubernetes.io/projected/054a0ee3-3117-4578-b0e4-eb41fdcc14e6-kube-api-access-xcn7c\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:29:46.345680 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:46.345648    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" path="/var/lib/kubelet/pods/054a0ee3-3117-4578-b0e4-eb41fdcc14e6/volumes"
Sep 10 00:29:46.769612 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:29:46.769534    2560 scope.go:117] "RemoveContainer" containerID="5834ccd5ee7ac6aeb9f4361c362a975c31b229346a09f3143877127aec33b345"
Sep 10 00:30:00.136016 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.135974    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816670-ptjqx"]
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136397    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c70ab0ff-7d56-4431-a4c5-fc8cce20b73a" containerName="maas-api"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136412    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c70ab0ff-7d56-4431-a4c5-fc8cce20b73a" containerName="maas-api"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136422    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136430    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136444    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7cfe1cc-61aa-4b16-9f35-2c288e866ec6" containerName="maas-api"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136451    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7cfe1cc-61aa-4b16-9f35-2c288e866ec6" containerName="maas-api"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136458    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerName="manager"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136463    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerName="manager"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136469    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136474    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136481    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerName="manager"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136486    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerName="manager"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136495    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136501    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136515    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136521    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136530    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerName="manager"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136535    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerName="manager"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136541    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136546    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136553    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136559    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136563    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1108ca8-fced-4f43-bfd9-a8fe102106ba" containerName="maas-api"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136569    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1108ca8-fced-4f43-bfd9-a8fe102106ba" containerName="maas-api"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136580    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136589    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136643    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerName="manager"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136650    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136656    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136666    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136673    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d8b3677-d98a-41fe-86b2-d0bbab81dbd6" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136680    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136686    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136692    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1108ca8-fced-4f43-bfd9-a8fe102106ba" containerName="maas-api"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136700    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7cfe1cc-61aa-4b16-9f35-2c288e866ec6" containerName="maas-api"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136706    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c70ab0ff-7d56-4431-a4c5-fc8cce20b73a" containerName="maas-api"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136711    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerName="manager"
Sep 10 00:30:00.138285 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136716    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy"
Sep 10 00:30:00.139531 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136721    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy"
Sep 10 00:30:00.139531 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.136726    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy"
Sep 10 00:30:00.139531 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.139475    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816670-ptjqx"
Sep 10 00:30:00.141865 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.141838    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxc4l\""
Sep 10 00:30:00.145881 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.145854    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816670-ptjqx"]
Sep 10 00:30:00.151387 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.151351    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816670-ptjqx"
Sep 10 00:30:00.423561 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.423535    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816670-ptjqx"]
Sep 10 00:30:00.425475 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:30:00.425447    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9999b8b_eaef_46ac_bf2c_5aed5aa9886a.slice/crio-50c8f801a41d01ca6b702fce8a7f756beb9fc3bf9dbe5979f0fef95288b0b365 WatchSource:0}: Error finding container 50c8f801a41d01ca6b702fce8a7f756beb9fc3bf9dbe5979f0fef95288b0b365: Status 404 returned error can't find the container with id 50c8f801a41d01ca6b702fce8a7f756beb9fc3bf9dbe5979f0fef95288b0b365
Sep 10 00:30:00.615894 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:00.615851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816670-ptjqx" event={"ID":"d9999b8b-eaef-46ac-bf2c-5aed5aa9886a","Type":"ContainerStarted","Data":"50c8f801a41d01ca6b702fce8a7f756beb9fc3bf9dbe5979f0fef95288b0b365"}
Sep 10 00:30:01.622636 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:01.622599    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9999b8b-eaef-46ac-bf2c-5aed5aa9886a" containerID="6bff1eb81fb8df2fbb9d37e9f4cd5f9275d925d78f2657eebfa949a0ccd7872f" exitCode=0
Sep 10 00:30:01.623063 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:01.622683    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816670-ptjqx" event={"ID":"d9999b8b-eaef-46ac-bf2c-5aed5aa9886a","Type":"ContainerDied","Data":"6bff1eb81fb8df2fbb9d37e9f4cd5f9275d925d78f2657eebfa949a0ccd7872f"}
Sep 10 00:30:02.761626 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:02.761598    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816670-ptjqx"
Sep 10 00:30:03.633157 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:03.633123    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816670-ptjqx"
Sep 10 00:30:03.633157 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:03.633152    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816670-ptjqx" event={"ID":"d9999b8b-eaef-46ac-bf2c-5aed5aa9886a","Type":"ContainerDied","Data":"50c8f801a41d01ca6b702fce8a7f756beb9fc3bf9dbe5979f0fef95288b0b365"}
Sep 10 00:30:03.633370 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:03.633194    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50c8f801a41d01ca6b702fce8a7f756beb9fc3bf9dbe5979f0fef95288b0b365"
Sep 10 00:30:43.141145 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:43.141055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:30:44.272349 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272315    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"]
Sep 10 00:30:44.272727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272658    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy"
Sep 10 00:30:44.272727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272669    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="38df01a5-b33b-4fdc-b80c-b724b25ba18b" containerName="istio-proxy"
Sep 10 00:30:44.272727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272678    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy"
Sep 10 00:30:44.272727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272684    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="41897496-473e-46e8-8a18-fcac29749541" containerName="istio-proxy"
Sep 10 00:30:44.272727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272699    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy"
Sep 10 00:30:44.272727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272705    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ad9e54b-a6dc-4317-8a2c-d1f2637a87e1" containerName="istio-proxy"
Sep 10 00:30:44.272727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272715    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9999b8b-eaef-46ac-bf2c-5aed5aa9886a" containerName="cleanup"
Sep 10 00:30:44.272727 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272720    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9999b8b-eaef-46ac-bf2c-5aed5aa9886a" containerName="cleanup"
Sep 10 00:30:44.273039 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272772    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="054a0ee3-3117-4578-b0e4-eb41fdcc14e6" containerName="manager"
Sep 10 00:30:44.273039 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272779    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9999b8b-eaef-46ac-bf2c-5aed5aa9886a" containerName="cleanup"
Sep 10 00:30:44.273039 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.272787    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3706079-08db-448e-afb0-2f6d9cf67085" containerName="istio-proxy"
Sep 10 00:30:44.275732 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.275710    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"
Sep 10 00:30:44.278389 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.278368    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ql4b9\""
Sep 10 00:30:44.292188 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.292157    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"]
Sep 10 00:30:44.430740 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.430706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e255cfaa-87eb-4ded-a871-76f525ba6dea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8mwlk\" (UID: \"e255cfaa-87eb-4ded-a871-76f525ba6dea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"
Sep 10 00:30:44.430903 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.430764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9sdz\" (UniqueName: \"kubernetes.io/projected/e255cfaa-87eb-4ded-a871-76f525ba6dea-kube-api-access-x9sdz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8mwlk\" (UID: \"e255cfaa-87eb-4ded-a871-76f525ba6dea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"
Sep 10 00:30:44.531702 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.531630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e255cfaa-87eb-4ded-a871-76f525ba6dea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8mwlk\" (UID: \"e255cfaa-87eb-4ded-a871-76f525ba6dea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"
Sep 10 00:30:44.531702 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.531678    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9sdz\" (UniqueName: \"kubernetes.io/projected/e255cfaa-87eb-4ded-a871-76f525ba6dea-kube-api-access-x9sdz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8mwlk\" (UID: \"e255cfaa-87eb-4ded-a871-76f525ba6dea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"
Sep 10 00:30:44.532015 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.531995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e255cfaa-87eb-4ded-a871-76f525ba6dea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8mwlk\" (UID: \"e255cfaa-87eb-4ded-a871-76f525ba6dea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"
Sep 10 00:30:44.539786 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.539757    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9sdz\" (UniqueName: \"kubernetes.io/projected/e255cfaa-87eb-4ded-a871-76f525ba6dea-kube-api-access-x9sdz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8mwlk\" (UID: \"e255cfaa-87eb-4ded-a871-76f525ba6dea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"
Sep 10 00:30:44.589792 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.589764    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"
Sep 10 00:30:44.872419 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:44.872388    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"]
Sep 10 00:30:44.873578 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:30:44.873550    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode255cfaa_87eb_4ded_a871_76f525ba6dea.slice/crio-fcd14fcb3cba5dad0976bc031310b4f7d18feaf81513d0cc9cc7fc132e5dc51c WatchSource:0}: Error finding container fcd14fcb3cba5dad0976bc031310b4f7d18feaf81513d0cc9cc7fc132e5dc51c: Status 404 returned error can't find the container with id fcd14fcb3cba5dad0976bc031310b4f7d18feaf81513d0cc9cc7fc132e5dc51c
Sep 10 00:30:45.831551 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:45.831513    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk" event={"ID":"e255cfaa-87eb-4ded-a871-76f525ba6dea","Type":"ContainerStarted","Data":"53be81c21f01f13067739d7956893d78ce7568aaed337cddfbfb4dbabcacfc43"}
Sep 10 00:30:45.831978 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:45.831572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk" event={"ID":"e255cfaa-87eb-4ded-a871-76f525ba6dea","Type":"ContainerStarted","Data":"fcd14fcb3cba5dad0976bc031310b4f7d18feaf81513d0cc9cc7fc132e5dc51c"}
Sep 10 00:30:45.831978 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:45.831602    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"
Sep 10 00:30:45.852148 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:45.852089    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk" podStartSLOduration=1.852073286 podStartE2EDuration="1.852073286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:30:45.849476875 +0000 UTC m=+2519.981604106" watchObservedRunningTime="2026-09-10 00:30:45.852073286 +0000 UTC m=+2519.984200514"
Sep 10 00:30:53.645458 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:53.645423    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:30:56.837747 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:30:56.837714    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8mwlk"
Sep 10 00:31:09.001783 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:09.001748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:31:17.409124 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:17.409088    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:31:31.957924 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.957855    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"]
Sep 10 00:31:31.961503 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.961484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:31.965198 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.965170    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 00:31:31.965312 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.965170    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-616e069e-kserve-self-signed-certs\""
Sep 10 00:31:31.965312 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.965214    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 00:31:31.965312 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.965174    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pbjt6\""
Sep 10 00:31:31.965866 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.965839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmwhp\" (UniqueName: \"kubernetes.io/projected/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-kube-api-access-lmwhp\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:31.965967 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.965879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-home\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:31.966021 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.965995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tmp-dir\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:31.966064 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.966047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-dshm\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:31.966102 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.966089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-model-cache\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:31.966150 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.966121    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tls-certs\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:31.970467 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:31.970446    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"]
Sep 10 00:31:32.066823 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.066795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tmp-dir\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.067032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.066836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-dshm\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.067032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.066861    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-model-cache\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.067032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.066887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tls-certs\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.067032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.066967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmwhp\" (UniqueName: \"kubernetes.io/projected/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-kube-api-access-lmwhp\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.067032 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.066994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-home\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.067295 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.067277    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-model-cache\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.067371 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.067331    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tmp-dir\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.067432 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.067400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-home\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.069163 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.069140    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-dshm\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.069295 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.069275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tls-certs\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.074427 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.074405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmwhp\" (UniqueName: \"kubernetes.io/projected/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-kube-api-access-lmwhp\") pod \"e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") " pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.271082 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.270992    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:32.494960 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.494906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:31:32.550150 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:32.550126    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"]
Sep 10 00:31:32.552272 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:31:32.552240    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93bf2fe5_7ae5_41e6_88af_97ed79095ab6.slice/crio-a0d0bc1afbb62cd5c88b31ca4e9f67d96877ba48f597c31aa88099a369deeef8 WatchSource:0}: Error finding container a0d0bc1afbb62cd5c88b31ca4e9f67d96877ba48f597c31aa88099a369deeef8: Status 404 returned error can't find the container with id a0d0bc1afbb62cd5c88b31ca4e9f67d96877ba48f597c31aa88099a369deeef8
Sep 10 00:31:33.070323 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:33.070287    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr" event={"ID":"93bf2fe5-7ae5-41e6-88af-97ed79095ab6","Type":"ContainerStarted","Data":"68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948"}
Sep 10 00:31:33.070728 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:33.070339    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr" event={"ID":"93bf2fe5-7ae5-41e6-88af-97ed79095ab6","Type":"ContainerStarted","Data":"a0d0bc1afbb62cd5c88b31ca4e9f67d96877ba48f597c31aa88099a369deeef8"}
Sep 10 00:31:33.087291 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:33.087241    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr" podStartSLOduration=2.087225491 podStartE2EDuration="2.087225491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:31:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:31:33.084691846 +0000 UTC m=+2567.216819074" watchObservedRunningTime="2026-09-10 00:31:33.087225491 +0000 UTC m=+2567.219352719"
Sep 10 00:31:34.498824 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:34.498793    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:31:35.370896 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:35.370857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:31:37.632103 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:37.632059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:31:37.685168 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:37.685138    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:31:42.271845 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:42.271815    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:42.272250 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:42.271859    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:42.289980 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:42.289949    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:31:42.898408 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:42.898373    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:31:43.130608 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:31:43.130578    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:32:28.309389 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:28.309300    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"]
Sep 10 00:32:28.327762 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:28.327736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:32:29.252499 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:29.252435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:32:31.300043 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:31.300008    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:32:39.595435 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:39.595395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:32:43.329178 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.329111    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr" podUID="93bf2fe5-7ae5-41e6-88af-97ed79095ab6" containerName="main" containerID="cri-o://68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948" gracePeriod=45
Sep 10 00:32:43.573112 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.573089    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:32:43.704595 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.704508    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmwhp\" (UniqueName: \"kubernetes.io/projected/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-kube-api-access-lmwhp\") pod \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") "
Sep 10 00:32:43.704595 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.704553    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tmp-dir\") pod \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") "
Sep 10 00:32:43.704595 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.704569    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-dshm\") pod \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") "
Sep 10 00:32:43.704882 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.704603    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tls-certs\") pod \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") "
Sep 10 00:32:43.704882 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.704620    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-home\") pod \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") "
Sep 10 00:32:43.704882 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.704659    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-model-cache\") pod \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\" (UID: \"93bf2fe5-7ae5-41e6-88af-97ed79095ab6\") "
Sep 10 00:32:43.704882 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.704806    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93bf2fe5-7ae5-41e6-88af-97ed79095ab6" (UID: "93bf2fe5-7ae5-41e6-88af-97ed79095ab6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:32:43.705078 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.704883    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-home" (OuterVolumeSpecName: "home") pod "93bf2fe5-7ae5-41e6-88af-97ed79095ab6" (UID: "93bf2fe5-7ae5-41e6-88af-97ed79095ab6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:32:43.705078 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.704989    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-model-cache" (OuterVolumeSpecName: "model-cache") pod "93bf2fe5-7ae5-41e6-88af-97ed79095ab6" (UID: "93bf2fe5-7ae5-41e6-88af-97ed79095ab6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:32:43.705078 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.705068    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tmp-dir\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:32:43.705187 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.705090    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-home\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:32:43.706801 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.706776    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-kube-api-access-lmwhp" (OuterVolumeSpecName: "kube-api-access-lmwhp") pod "93bf2fe5-7ae5-41e6-88af-97ed79095ab6" (UID: "93bf2fe5-7ae5-41e6-88af-97ed79095ab6"). InnerVolumeSpecName "kube-api-access-lmwhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:32:43.706914 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.706807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93bf2fe5-7ae5-41e6-88af-97ed79095ab6" (UID: "93bf2fe5-7ae5-41e6-88af-97ed79095ab6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:32:43.706914 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.706834    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-dshm" (OuterVolumeSpecName: "dshm") pod "93bf2fe5-7ae5-41e6-88af-97ed79095ab6" (UID: "93bf2fe5-7ae5-41e6-88af-97ed79095ab6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 00:32:43.806270 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.806245    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-dshm\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:32:43.806270 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.806266    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-tls-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:32:43.806270 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.806277    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-model-cache\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:32:43.806465 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:43.806285    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmwhp\" (UniqueName: \"kubernetes.io/projected/93bf2fe5-7ae5-41e6-88af-97ed79095ab6-kube-api-access-lmwhp\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:32:44.421397 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:44.421364    2560 generic.go:356] "Generic (PLEG): container finished" podID="93bf2fe5-7ae5-41e6-88af-97ed79095ab6" containerID="68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948" exitCode=0
Sep 10 00:32:44.421788 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:44.421405    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"
Sep 10 00:32:44.421788 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:44.421423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr" event={"ID":"93bf2fe5-7ae5-41e6-88af-97ed79095ab6","Type":"ContainerDied","Data":"68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948"}
Sep 10 00:32:44.421788 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:44.421456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr" event={"ID":"93bf2fe5-7ae5-41e6-88af-97ed79095ab6","Type":"ContainerDied","Data":"a0d0bc1afbb62cd5c88b31ca4e9f67d96877ba48f597c31aa88099a369deeef8"}
Sep 10 00:32:44.421788 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:44.421477    2560 scope.go:117] "RemoveContainer" containerID="68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948"
Sep 10 00:32:44.430228 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:44.430207    2560 scope.go:117] "RemoveContainer" containerID="68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948"
Sep 10 00:32:44.430483 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:32:44.430463    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948\": container with ID starting with 68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948 not found: ID does not exist" containerID="68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948"
Sep 10 00:32:44.430550 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:44.430491    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948"} err="failed to get container status \"68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948\": rpc error: code = NotFound desc = could not find container \"68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948\": container with ID starting with 68f3c2f0f72a00e5c03a663a2716f424e8c1cd01c6d45355cbe4fe9ec7854948 not found: ID does not exist"
Sep 10 00:32:44.437133 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:44.437110    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"]
Sep 10 00:32:44.440739 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:44.440717    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-616e069e-kserve-79b697b64c-9kvbr"]
Sep 10 00:32:46.339710 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:46.339676    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93bf2fe5-7ae5-41e6-88af-97ed79095ab6" path="/var/lib/kubelet/pods/93bf2fe5-7ae5-41e6-88af-97ed79095ab6/volumes"
Sep 10 00:32:47.297012 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.296956    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"]
Sep 10 00:32:47.297344 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.297328    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bf2fe5-7ae5-41e6-88af-97ed79095ab6" containerName="main"
Sep 10 00:32:47.297344 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.297345    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bf2fe5-7ae5-41e6-88af-97ed79095ab6" containerName="main"
Sep 10 00:32:47.297877 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.297435    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="93bf2fe5-7ae5-41e6-88af-97ed79095ab6" containerName="main"
Sep 10 00:32:47.301945 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.301911    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.305499 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.305476    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 00:32:47.305623 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.305478    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 00:32:47.305623 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.305517    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 00:32:47.305623 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.305517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h47kt\""
Sep 10 00:32:47.305623 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.305481    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 00:32:47.311144 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.311122    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"]
Sep 10 00:32:47.315077 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.315057    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"]
Sep 10 00:32:47.315197 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.315157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.325608 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.325586    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"]
Sep 10 00:32:47.440169 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.440136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09b955ad-d388-4de7-936b-50320e33528d-maas-api-tls\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.440169 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.440171    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzk25\" (UniqueName: \"kubernetes.io/projected/94c16cc1-72d0-4c9e-8b91-f383df08047d-kube-api-access-rzk25\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.440752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.440198    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zf2g\" (UniqueName: \"kubernetes.io/projected/09b955ad-d388-4de7-936b-50320e33528d-kube-api-access-2zf2g\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.440752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.440269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c16cc1-72d0-4c9e-8b91-f383df08047d-openshift-service-ca\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.440752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.440317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-metrics-certs\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.440752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.440364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-maas-api-tls\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.440752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.440618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09b955ad-d388-4de7-936b-50320e33528d-metrics-certs\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.440752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.440743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09b955ad-d388-4de7-936b-50320e33528d-openshift-service-ca\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.498995 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.498968    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:32:47.541981 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.541957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09b955ad-d388-4de7-936b-50320e33528d-openshift-service-ca\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.542145 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.542005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09b955ad-d388-4de7-936b-50320e33528d-maas-api-tls\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.542145 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.542023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzk25\" (UniqueName: \"kubernetes.io/projected/94c16cc1-72d0-4c9e-8b91-f383df08047d-kube-api-access-rzk25\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.542280 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.542189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zf2g\" (UniqueName: \"kubernetes.io/projected/09b955ad-d388-4de7-936b-50320e33528d-kube-api-access-2zf2g\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.542280 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.542232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c16cc1-72d0-4c9e-8b91-f383df08047d-openshift-service-ca\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.542280 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.542270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-metrics-certs\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.542437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.542298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-maas-api-tls\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.542437 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.542351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09b955ad-d388-4de7-936b-50320e33528d-metrics-certs\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.543128 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.543103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09b955ad-d388-4de7-936b-50320e33528d-openshift-service-ca\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.543483 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.543448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c16cc1-72d0-4c9e-8b91-f383df08047d-openshift-service-ca\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.545463 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.545370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09b955ad-d388-4de7-936b-50320e33528d-metrics-certs\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.545463 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.545374    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-metrics-certs\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.546542 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.546516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-maas-api-tls\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.546640 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.546543    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09b955ad-d388-4de7-936b-50320e33528d-maas-api-tls\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.550182 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.550122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzk25\" (UniqueName: \"kubernetes.io/projected/94c16cc1-72d0-4c9e-8b91-f383df08047d-kube-api-access-rzk25\") pod \"maas-api-75b96c447f-kwqrh\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") " pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.551019 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.550995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zf2g\" (UniqueName: \"kubernetes.io/projected/09b955ad-d388-4de7-936b-50320e33528d-kube-api-access-2zf2g\") pod \"maas-api-7895df9f99-hvrw5\" (UID: \"09b955ad-d388-4de7-936b-50320e33528d\") " pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.614009 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.613984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:47.627039 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.627019    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:47.900293 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.900213    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"]
Sep 10 00:32:47.903507 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:32:47.903475    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c16cc1_72d0_4c9e_8b91_f383df08047d.slice/crio-7d0a974511d722f2d9817a556ab6197b5d43dc6832b120a46f16a5941a5333fa WatchSource:0}: Error finding container 7d0a974511d722f2d9817a556ab6197b5d43dc6832b120a46f16a5941a5333fa: Status 404 returned error can't find the container with id 7d0a974511d722f2d9817a556ab6197b5d43dc6832b120a46f16a5941a5333fa
Sep 10 00:32:47.904834 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.904816    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 00:32:47.912752 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:47.912731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"]
Sep 10 00:32:47.915460 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:32:47.915436    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b955ad_d388_4de7_936b_50320e33528d.slice/crio-a8ad3a857ced300d62705e9badb5a80dca6f3a7d99e4ac967af03e09381b0758 WatchSource:0}: Error finding container a8ad3a857ced300d62705e9badb5a80dca6f3a7d99e4ac967af03e09381b0758: Status 404 returned error can't find the container with id a8ad3a857ced300d62705e9badb5a80dca6f3a7d99e4ac967af03e09381b0758
Sep 10 00:32:48.444013 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:48.443969    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh" event={"ID":"94c16cc1-72d0-4c9e-8b91-f383df08047d","Type":"ContainerStarted","Data":"7d0a974511d722f2d9817a556ab6197b5d43dc6832b120a46f16a5941a5333fa"}
Sep 10 00:32:48.445235 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:48.445212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5" event={"ID":"09b955ad-d388-4de7-936b-50320e33528d","Type":"ContainerStarted","Data":"a8ad3a857ced300d62705e9badb5a80dca6f3a7d99e4ac967af03e09381b0758"}
Sep 10 00:32:49.452144 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:49.452098    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5" event={"ID":"09b955ad-d388-4de7-936b-50320e33528d","Type":"ContainerStarted","Data":"b5abf9a95dcc6ff99d66351f22188cd094ebf2902efea13baf7a7408a20dc366"}
Sep 10 00:32:49.452627 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:49.452180    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:49.453690 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:49.453661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh" event={"ID":"94c16cc1-72d0-4c9e-8b91-f383df08047d","Type":"ContainerStarted","Data":"fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d"}
Sep 10 00:32:49.453806 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:49.453782    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:49.468767 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:49.468724    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5" podStartSLOduration=1.355937271 podStartE2EDuration="2.468710648s" totalImagesPullingTime="1.112773377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:32:49.467097386 +0000 UTC m=+2643.599224615" watchObservedRunningTime="2026-09-10 00:32:49.468710648 +0000 UTC m=+2643.600837873"
Sep 10 00:32:49.484553 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:49.484510    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh" podStartSLOduration=1.943846222 podStartE2EDuration="2.484495852s" totalImagesPullingTime="540.64963ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:32:49.48244835 +0000 UTC m=+2643.614575579" watchObservedRunningTime="2026-09-10 00:32:49.484495852 +0000 UTC m=+2643.616623079"
Sep 10 00:32:54.794395 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:54.794357    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:32:55.465710 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.465681    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7895df9f99-hvrw5"
Sep 10 00:32:55.466191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.466170    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:55.527777 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.527742    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"]
Sep 10 00:32:55.528028 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.527996    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh" podUID="94c16cc1-72d0-4c9e-8b91-f383df08047d" containerName="maas-api" containerID="cri-o://fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d" gracePeriod=30
Sep 10 00:32:55.782532 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.782496    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:55.914195 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.914158    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-maas-api-tls\") pod \"94c16cc1-72d0-4c9e-8b91-f383df08047d\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") "
Sep 10 00:32:55.914195 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.914195    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzk25\" (UniqueName: \"kubernetes.io/projected/94c16cc1-72d0-4c9e-8b91-f383df08047d-kube-api-access-rzk25\") pod \"94c16cc1-72d0-4c9e-8b91-f383df08047d\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") "
Sep 10 00:32:55.914719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.914251    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c16cc1-72d0-4c9e-8b91-f383df08047d-openshift-service-ca\") pod \"94c16cc1-72d0-4c9e-8b91-f383df08047d\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") "
Sep 10 00:32:55.914719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.914279    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-metrics-certs\") pod \"94c16cc1-72d0-4c9e-8b91-f383df08047d\" (UID: \"94c16cc1-72d0-4c9e-8b91-f383df08047d\") "
Sep 10 00:32:55.914719 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.914565    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94c16cc1-72d0-4c9e-8b91-f383df08047d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94c16cc1-72d0-4c9e-8b91-f383df08047d" (UID: "94c16cc1-72d0-4c9e-8b91-f383df08047d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 00:32:55.916223 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.916199    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94c16cc1-72d0-4c9e-8b91-f383df08047d" (UID: "94c16cc1-72d0-4c9e-8b91-f383df08047d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:32:55.916398 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.916377    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "94c16cc1-72d0-4c9e-8b91-f383df08047d" (UID: "94c16cc1-72d0-4c9e-8b91-f383df08047d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 00:32:55.916451 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:55.916394    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94c16cc1-72d0-4c9e-8b91-f383df08047d-kube-api-access-rzk25" (OuterVolumeSpecName: "kube-api-access-rzk25") pod "94c16cc1-72d0-4c9e-8b91-f383df08047d" (UID: "94c16cc1-72d0-4c9e-8b91-f383df08047d"). InnerVolumeSpecName "kube-api-access-rzk25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 00:32:56.015491 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.015409    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c16cc1-72d0-4c9e-8b91-f383df08047d-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:32:56.015491 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.015437    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-metrics-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:32:56.015491 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.015446    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94c16cc1-72d0-4c9e-8b91-f383df08047d-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:32:56.015491 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.015454    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzk25\" (UniqueName: \"kubernetes.io/projected/94c16cc1-72d0-4c9e-8b91-f383df08047d-kube-api-access-rzk25\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Sep 10 00:32:56.490522 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.490485    2560 generic.go:356] "Generic (PLEG): container finished" podID="94c16cc1-72d0-4c9e-8b91-f383df08047d" containerID="fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d" exitCode=0
Sep 10 00:32:56.490687 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.490535    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"
Sep 10 00:32:56.490687 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.490576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh" event={"ID":"94c16cc1-72d0-4c9e-8b91-f383df08047d","Type":"ContainerDied","Data":"fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d"}
Sep 10 00:32:56.490687 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.490634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh" event={"ID":"94c16cc1-72d0-4c9e-8b91-f383df08047d","Type":"ContainerDied","Data":"7d0a974511d722f2d9817a556ab6197b5d43dc6832b120a46f16a5941a5333fa"}
Sep 10 00:32:56.490687 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.490657    2560 scope.go:117] "RemoveContainer" containerID="fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d"
Sep 10 00:32:56.499354 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.499341    2560 scope.go:117] "RemoveContainer" containerID="fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d"
Sep 10 00:32:56.499607 ip-10-0-128-118 kubenswrapper[2560]: E0910 00:32:56.499589    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d\": container with ID starting with fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d not found: ID does not exist" containerID="fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d"
Sep 10 00:32:56.499673 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.499613    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d"} err="failed to get container status \"fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d\": rpc error: code = NotFound desc = could not find container \"fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d\": container with ID starting with fac462059772b83318e777a7b9f2a1aa027f6d3cef67c235eb99d85e2d396d9d not found: ID does not exist"
Sep 10 00:32:56.506479 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.506458    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"]
Sep 10 00:32:56.509884 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:56.509853    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-75b96c447f-kwqrh"]
Sep 10 00:32:58.339798 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:32:58.339760    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94c16cc1-72d0-4c9e-8b91-f383df08047d" path="/var/lib/kubelet/pods/94c16cc1-72d0-4c9e-8b91-f383df08047d/volumes"
Sep 10 00:33:01.395416 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:01.395380    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:33:06.901821 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:06.901782    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:33:13.899493 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:13.899459    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6wxtk"]
Sep 10 00:33:23.199721 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:23.199693    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cfd54796-cz2sf_3e612a9c-f096-44a0-b074-de1146008b0c/copy-manifests/0.log"
Sep 10 00:33:23.206108 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:23.206086    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cfd54796-cz2sf_3e612a9c-f096-44a0-b074-de1146008b0c/manager/0.log"
Sep 10 00:33:23.782449 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:23.782412    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7895df9f99-hvrw5_09b955ad-d388-4de7-936b-50320e33528d/maas-api/0.log"
Sep 10 00:33:23.886372 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:23.886343    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816655-jgxr2_3b7b8b1a-f722-44c4-8813-468017d497ce/cleanup/0.log"
Sep 10 00:33:23.989770 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:23.989742    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816670-ptjqx_d9999b8b-eaef-46ac-bf2c-5aed5aa9886a/cleanup/0.log"
Sep 10 00:33:25.097148 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:25.097113    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-wvmtv_b08319e6-e048-4c0f-a333-ea3a659a17c0/manager/0.log"
Sep 10 00:33:25.339894 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:25.339860    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-8mwlk_e255cfaa-87eb-4ded-a871-76f525ba6dea/manager/0.log"
Sep 10 00:33:25.449145 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:25.449079    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6wxtk_1a2399c3-207b-49ff-9874-83d572e9f7e2/limitador/0.log"
Sep 10 00:33:25.571850 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:25.571819    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-qw85m_db003c1f-2811-4f0b-91c4-a9b605533bb5/manager/0.log"
Sep 10 00:33:25.901870 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:25.901841    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799czjkjt_6e313ddd-5fae-460b-bb4a-79aeb3a86a53/istio-proxy/0.log"
Sep 10 00:33:26.020837 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:26.020801    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rsfpf_ac53f64c-3f85-49fb-b9f3-13d210291fbf/discovery/0.log"
Sep 10 00:33:26.233861 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:26.233777    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fbcb8d956-mmjvl_2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82/kube-auth-proxy/0.log"
Sep 10 00:33:26.346784 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:26.346751    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-h77w6_d09b46f0-9ce3-4149-a211-e9d242c1d43b/istio-proxy/1.log"
Sep 10 00:33:26.694199 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:26.694170    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565d5b7686-dcqqw_35cca434-76f0-464e-88ad-46d76c8ef6bf/router/0.log"
Sep 10 00:33:33.194399 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:33.194357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:33:33.258289 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:33.258261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log" limit=1024
Sep 10 00:33:36.778482 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:36.778449    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6lnx6_1e350ffb-631f-4f97-ba20-f4b8d39b08e1/global-pull-secret-syncer/0.log"
Sep 10 00:33:36.863903 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:36.863872    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7g9v9_ddbef9d3-82f2-4fc2-a0e5-ed0987e5bc89/konnectivity-agent/0.log"
Sep 10 00:33:36.946402 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:36.946375    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-118.ec2.internal_29f890174e08c201af11a053bc521344/haproxy/0.log"
Sep 10 00:33:42.033720 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:42.033683    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-wvmtv_b08319e6-e048-4c0f-a333-ea3a659a17c0/manager/0.log"
Sep 10 00:33:42.120765 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:42.120733    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-8mwlk_e255cfaa-87eb-4ded-a871-76f525ba6dea/manager/0.log"
Sep 10 00:33:42.143338 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:42.143291    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6wxtk_1a2399c3-207b-49ff-9874-83d572e9f7e2/limitador/0.log"
Sep 10 00:33:42.217829 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:42.217799    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-qw85m_db003c1f-2811-4f0b-91c4-a9b605533bb5/manager/0.log"
Sep 10 00:33:43.789995 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:43.789962    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zwrgv_66553526-7695-422c-8ebf-c578bf5bd458/kube-state-metrics/0.log"
Sep 10 00:33:43.805744 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:43.805720    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zwrgv_66553526-7695-422c-8ebf-c578bf5bd458/kube-rbac-proxy-main/0.log"
Sep 10 00:33:43.823321 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:43.823301    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zwrgv_66553526-7695-422c-8ebf-c578bf5bd458/kube-rbac-proxy-self/0.log"
Sep 10 00:33:43.903738 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:43.903709    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qk8f5_ae6b8af0-f2c1-40dd-8ead-455d2f869a7d/node-exporter/0.log"
Sep 10 00:33:43.920273 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:43.920252    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qk8f5_ae6b8af0-f2c1-40dd-8ead-455d2f869a7d/kube-rbac-proxy/0.log"
Sep 10 00:33:43.938281 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:43.938263    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qk8f5_ae6b8af0-f2c1-40dd-8ead-455d2f869a7d/init-textfile/0.log"
Sep 10 00:33:44.093518 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:44.093493    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-xjmgf_2015d09d-69b1-49af-95a3-d52877799b19/kube-rbac-proxy-main/0.log"
Sep 10 00:33:44.114415 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:44.114396    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-xjmgf_2015d09d-69b1-49af-95a3-d52877799b19/kube-rbac-proxy-self/0.log"
Sep 10 00:33:44.135160 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:44.135141    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-xjmgf_2015d09d-69b1-49af-95a3-d52877799b19/openshift-state-metrics/0.log"
Sep 10 00:33:44.377452 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:44.377377    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-dkmp7_292063f9-30cd-4049-a7a2-9fc3ec249384/prometheus-operator/0.log"
Sep 10 00:33:44.391153 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:44.391127    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-dkmp7_292063f9-30cd-4049-a7a2-9fc3ec249384/kube-rbac-proxy/0.log"
Sep 10 00:33:44.450723 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:44.450699    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb55ccf6b-6dnvm_b4a67114-2a19-4f6c-804e-7ae407147262/telemeter-client/0.log"
Sep 10 00:33:44.468268 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:44.468243    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb55ccf6b-6dnvm_b4a67114-2a19-4f6c-804e-7ae407147262/reload/0.log"
Sep 10 00:33:44.490837 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:44.490817    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb55ccf6b-6dnvm_b4a67114-2a19-4f6c-804e-7ae407147262/kube-rbac-proxy/0.log"
Sep 10 00:33:46.537444 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:46.537412    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:33:46.541780 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:46.541758    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:33:46.559434 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:46.559399    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/2.log"
Sep 10 00:33:46.566613 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:46.566591    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tv6x5_adc8c692-e97a-46be-8bac-a7281df3f53c/console-operator/3.log"
Sep 10 00:33:47.047961 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.047916    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"]
Sep 10 00:33:47.048305 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.048291    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94c16cc1-72d0-4c9e-8b91-f383df08047d" containerName="maas-api"
Sep 10 00:33:47.048305 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.048306    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="94c16cc1-72d0-4c9e-8b91-f383df08047d" containerName="maas-api"
Sep 10 00:33:47.048407 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.048383    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="94c16cc1-72d0-4c9e-8b91-f383df08047d" containerName="maas-api"
Sep 10 00:33:47.052693 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.052675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.055105 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.055086    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2hczq\"/\"default-dockercfg-r77nj\""
Sep 10 00:33:47.055105 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.055098    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hczq\"/\"openshift-service-ca.crt\""
Sep 10 00:33:47.056060 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.056040    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hczq\"/\"kube-root-ca.crt\""
Sep 10 00:33:47.060634 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.060612    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"]
Sep 10 00:33:47.145488 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.145398    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b4868bfb-mmgtr_ac22dbde-9e34-4712-8e1e-e8f58c622d15/console/0.log"
Sep 10 00:33:47.158883 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.158850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-proc\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.159046 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.158910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-podres\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.159046 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.158969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-lib-modules\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.159046 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.158997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-sys\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.159178 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.159092    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgpj9\" (UniqueName: \"kubernetes.io/projected/17b8f501-e642-4408-950a-822b5c32d209-kube-api-access-mgpj9\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.180848 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.180824    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-z9t85_abd6d518-ab23-4546-8b79-b774fe81338e/download-server/0.log"
Sep 10 00:33:47.260059 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.260035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-podres\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.260194 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.260064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-lib-modules\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.260194 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.260084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-sys\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.260194 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.260142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgpj9\" (UniqueName: \"kubernetes.io/projected/17b8f501-e642-4408-950a-822b5c32d209-kube-api-access-mgpj9\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.260194 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.260174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-proc\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.260366 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.260193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-podres\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.260366 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.260229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-lib-modules\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.260366 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.260243    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-sys\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.260366 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.260251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17b8f501-e642-4408-950a-822b5c32d209-proc\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.268380 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.268357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgpj9\" (UniqueName: \"kubernetes.io/projected/17b8f501-e642-4408-950a-822b5c32d209-kube-api-access-mgpj9\") pod \"perf-node-gather-daemonset-gd45s\" (UID: \"17b8f501-e642-4408-950a-822b5c32d209\") " pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.363634 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.363612    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:47.632601 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.632577    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"]
Sep 10 00:33:47.634719 ip-10-0-128-118 kubenswrapper[2560]: W0910 00:33:47.634690    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod17b8f501_e642_4408_950a_822b5c32d209.slice/crio-39927245aadc48a0641f3122471363b5ccc9258fbddfe2d8f6872604a999a3de WatchSource:0}: Error finding container 39927245aadc48a0641f3122471363b5ccc9258fbddfe2d8f6872604a999a3de: Status 404 returned error can't find the container with id 39927245aadc48a0641f3122471363b5ccc9258fbddfe2d8f6872604a999a3de
Sep 10 00:33:47.746421 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.746390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s" event={"ID":"17b8f501-e642-4408-950a-822b5c32d209","Type":"ContainerStarted","Data":"39927245aadc48a0641f3122471363b5ccc9258fbddfe2d8f6872604a999a3de"}
Sep 10 00:33:47.897775 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:47.897745    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-h8k7s_b682550c-5cd7-4707-a255-a4324d3695ba/volume-data-source-validator/0.log"
Sep 10 00:33:48.752840 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:48.752800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s" event={"ID":"17b8f501-e642-4408-950a-822b5c32d209","Type":"ContainerStarted","Data":"17ce2584b9d54fd51e6fa46010e9d4b49acd1ebb63d20cbba0926ac71eeb01ec"}
Sep 10 00:33:48.753321 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:48.752876    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:48.768243 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:48.768179    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s" podStartSLOduration=1.768165947 podStartE2EDuration="1.768165947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:33:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:33:48.766757966 +0000 UTC m=+2702.898885197" watchObservedRunningTime="2026-09-10 00:33:48.768165947 +0000 UTC m=+2702.900293174"
Sep 10 00:33:48.994874 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:48.994845    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4g6xz_3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0/dns/0.log"
Sep 10 00:33:49.013191 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:49.013115    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4g6xz_3c2a20d1-8bd4-4578-ac2d-ba93ee0539e0/kube-rbac-proxy/0.log"
Sep 10 00:33:49.116275 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:49.116243    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-77v6t_7171a24b-d7c1-415c-a7e3-a88b72df36fb/dns-node-resolver/0.log"
Sep 10 00:33:49.711461 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:49.711432    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2n8gz_daf0b287-7915-4114-afcb-cf729ae449bc/node-ca/0.log"
Sep 10 00:33:50.629712 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:50.629660    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799czjkjt_6e313ddd-5fae-460b-bb4a-79aeb3a86a53/istio-proxy/0.log"
Sep 10 00:33:51.139963 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:51.139903    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rsfpf_ac53f64c-3f85-49fb-b9f3-13d210291fbf/discovery/0.log"
Sep 10 00:33:51.179378 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:51.179346    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fbcb8d956-mmjvl_2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82/kube-auth-proxy/0.log"
Sep 10 00:33:51.209224 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:51.209197    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-h77w6_d09b46f0-9ce3-4149-a211-e9d242c1d43b/istio-proxy/0.log"
Sep 10 00:33:51.214761 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:51.214734    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-h77w6_d09b46f0-9ce3-4149-a211-e9d242c1d43b/istio-proxy/1.log"
Sep 10 00:33:51.293345 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:51.293319    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565d5b7686-dcqqw_35cca434-76f0-464e-88ad-46d76c8ef6bf/router/0.log"
Sep 10 00:33:52.147056 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:52.147026    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6ps48_2b962128-2af7-4357-8058-dbae23fd13f8/serve-healthcheck-canary/0.log"
Sep 10 00:33:52.703257 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:52.703231    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8jf24_cd7f1ee0-cf47-4989-baf1-cb22b3aadafb/kube-rbac-proxy/0.log"
Sep 10 00:33:52.721824 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:52.721799    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8jf24_cd7f1ee0-cf47-4989-baf1-cb22b3aadafb/exporter/0.log"
Sep 10 00:33:52.740880 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:52.740857    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8jf24_cd7f1ee0-cf47-4989-baf1-cb22b3aadafb/extractor/0.log"
Sep 10 00:33:54.768114 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:54.768074    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2hczq/perf-node-gather-daemonset-gd45s"
Sep 10 00:33:55.384354 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:55.384323    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cfd54796-cz2sf_3e612a9c-f096-44a0-b074-de1146008b0c/manager/0.log"
Sep 10 00:33:55.400077 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:55.400045    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cfd54796-cz2sf_3e612a9c-f096-44a0-b074-de1146008b0c/copy-manifests/0.log"
Sep 10 00:33:56.611707 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:56.611668    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-k7wdx_06b28ca2-52cb-4b1c-8be6-eb0e49df1840/openshift-lws-operator/0.log"
Sep 10 00:33:56.826803 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:56.826749    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799czjkjt_6e313ddd-5fae-460b-bb4a-79aeb3a86a53/istio-proxy/0.log"
Sep 10 00:33:57.357894 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:57.357862    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rsfpf_ac53f64c-3f85-49fb-b9f3-13d210291fbf/discovery/0.log"
Sep 10 00:33:57.383310 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:57.383281    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fbcb8d956-mmjvl_2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82/kube-auth-proxy/0.log"
Sep 10 00:33:57.403628 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:57.403584    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-h77w6_d09b46f0-9ce3-4149-a211-e9d242c1d43b/istio-proxy/0.log"
Sep 10 00:33:57.408302 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:57.408278    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-h77w6_d09b46f0-9ce3-4149-a211-e9d242c1d43b/istio-proxy/1.log"
Sep 10 00:33:57.483348 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:57.483325    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565d5b7686-dcqqw_35cca434-76f0-464e-88ad-46d76c8ef6bf/router/0.log"
Sep 10 00:33:59.056463 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:59.056434    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799czjkjt_6e313ddd-5fae-460b-bb4a-79aeb3a86a53/istio-proxy/0.log"
Sep 10 00:33:59.568486 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:59.568447    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rsfpf_ac53f64c-3f85-49fb-b9f3-13d210291fbf/discovery/0.log"
Sep 10 00:33:59.602357 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:59.602326    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fbcb8d956-mmjvl_2a651e7d-16f7-4aed-b5f1-7d9e21f7ac82/kube-auth-proxy/0.log"
Sep 10 00:33:59.627557 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:59.627527    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-h77w6_d09b46f0-9ce3-4149-a211-e9d242c1d43b/istio-proxy/0.log"
Sep 10 00:33:59.632734 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:59.632687    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-h77w6_d09b46f0-9ce3-4149-a211-e9d242c1d43b/istio-proxy/1.log"
Sep 10 00:33:59.699681 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:33:59.699656    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565d5b7686-dcqqw_35cca434-76f0-464e-88ad-46d76c8ef6bf/router/0.log"
Sep 10 00:34:02.106291 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:02.106263    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-wx78c_fcdf5c12-206b-412c-9710-e39940b8d115/kube-storage-version-migrator-operator/1.log"
Sep 10 00:34:02.107985 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:02.107956    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-wx78c_fcdf5c12-206b-412c-9710-e39940b8d115/kube-storage-version-migrator-operator/0.log"
Sep 10 00:34:03.069364 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:03.069332    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5fgsw_636c9650-cf74-4c56-8595-afdb6d29702e/kube-multus/0.log"
Sep 10 00:34:03.367460 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:03.367378    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqld6_9f567dc0-4b50-4f89-8c59-6857c128767a/kube-multus-additional-cni-plugins/0.log"
Sep 10 00:34:03.385165 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:03.385141    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqld6_9f567dc0-4b50-4f89-8c59-6857c128767a/egress-router-binary-copy/0.log"
Sep 10 00:34:03.401651 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:03.401632    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqld6_9f567dc0-4b50-4f89-8c59-6857c128767a/cni-plugins/0.log"
Sep 10 00:34:03.417548 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:03.417531    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqld6_9f567dc0-4b50-4f89-8c59-6857c128767a/bond-cni-plugin/0.log"
Sep 10 00:34:03.434543 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:03.434515    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqld6_9f567dc0-4b50-4f89-8c59-6857c128767a/routeoverride-cni/0.log"
Sep 10 00:34:03.454095 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:03.454075    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqld6_9f567dc0-4b50-4f89-8c59-6857c128767a/whereabouts-cni-bincopy/0.log"
Sep 10 00:34:03.471245 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:03.471228    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqld6_9f567dc0-4b50-4f89-8c59-6857c128767a/whereabouts-cni/0.log"
Sep 10 00:34:03.540742 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:03.540719    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pjdw5_b6a27c9e-ee55-4d2b-ac35-25b474a89304/network-metrics-daemon/0.log"
Sep 10 00:34:03.554240 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:03.554213    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pjdw5_b6a27c9e-ee55-4d2b-ac35-25b474a89304/kube-rbac-proxy/0.log"
Sep 10 00:34:04.815667 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:04.815635    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xzg8m_02cf0c64-f280-44e2-8fcf-5c96f9d88cef/ovn-controller/0.log"
Sep 10 00:34:04.828602 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:04.828574    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xzg8m_02cf0c64-f280-44e2-8fcf-5c96f9d88cef/ovn-acl-logging/0.log"
Sep 10 00:34:04.853552 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:04.853522    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xzg8m_02cf0c64-f280-44e2-8fcf-5c96f9d88cef/kube-rbac-proxy-node/0.log"
Sep 10 00:34:04.875638 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:04.875617    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xzg8m_02cf0c64-f280-44e2-8fcf-5c96f9d88cef/kube-rbac-proxy-ovn-metrics/0.log"
Sep 10 00:34:04.889429 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:04.889403    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xzg8m_02cf0c64-f280-44e2-8fcf-5c96f9d88cef/northd/0.log"
Sep 10 00:34:04.906663 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:04.906628    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xzg8m_02cf0c64-f280-44e2-8fcf-5c96f9d88cef/nbdb/0.log"
Sep 10 00:34:04.924714 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:04.924685    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xzg8m_02cf0c64-f280-44e2-8fcf-5c96f9d88cef/sbdb/0.log"
Sep 10 00:34:05.022848 ip-10-0-128-118 kubenswrapper[2560]: I0910 00:34:05.022817    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xzg8m_02cf0c64-f280-44e2-8fcf-5c96f9d88cef/ovnkube-controller/0.log"